Machine Learning
The Truth Was Never Gone: Perfect Aliasing in Compliant-Context Truth Probes
Dylan Jayabahu
Linear probes that decode the truth from a
language model's activations have been proposed as deception monitors, and a truth probe scoring below chance on a model trained to deceive is naturally read as evidence that the model hid or stopped representing the truth. We show that a fitting-label ambiguity can produce the same readout. In a controlled game, a model should report a secret bit to an ally and its complement to a rival. On compliant (ally) contexts the true bit and the answer the task prescribes are identical labels, so a probe fitted there cannot tell which of the two it measures. We call this complete agreement perfect aliasing. The labels are complements on rival contexts, so one ally-fitted probe scored against each has rival AUROCs that sum to one. Mixed fitting, on ally and rival contexts together, makes the two labels differ; randomized output codebooks also decouple the prescribed answer from the output letter. For a reward-trained Gemma-2-9B policy that answers falsely on every evaluated rival trial, the ally-fitted probe scores $0.006 \pm 0.005$ AUROC at the final layer (mean $\pm$ sample SD over three RL training seeds), while mixed-fit probes score 1.000 on the same held-out activations. Mixed fitting also uses more examples and labelled rival data, so this shows the true bit remains linearly recoverable, not that separating the labels alone explains the gain. In instructed Llama-3.1-8B, a probe refitted on one
prompt variant and one frozen from a reference variant both have held-out ally accuracy 1.000 but rival truth AUROCs of 0.080 and 0.986 on the same trials. Our main experiments use one single-
token game that states the bit in the
prompt, so the recovered direction may read a retained copy of it; where the model must infer the bit, no tested arm deceives reliably. We study what a probe measures, not whether the model uses that information.
Read the full abstract ▾
Human-Computer Interaction
What Makes Creation Human? Authorship, Reasons, and Meaningful Human Control in Generative AI
Yuxi Cao
Generative artificial intelligence (GenAI) significantly expands creators' productive capacity, but this does not necessarily entail a corresponding increase in creative agency or authorship. This paper distinguishes creativity at the level of the work from creative agency at the level of the creator, and argues that human authorship cannot be determined solely by manual intervention, degree of automation, the origin of an initial idea, or final selection authority. Rather, authorship depends on whether human judgment and reasons genuinely shape the development of the work. To articulate this requirement, the paper introduces Meaningful Human Control (MHC) into generative creation and identifies a limitation of its classical tracking condition. Creative reasons are not always fully specified prior to interaction with AI; they may emerge, change, or be abandoned as the creative process unfolds. The paper therefore proposes dynamic-reflexive tracking (DRT), which requires that a creator's evolving reasons undergo reflective uptake, exert genuine influence on the subsequent trajectory of creation, and remain capable of rejecting and redirecting the system's default direction. DRT consists of four conditions: diachronic reason formation, reflective uptake, trajectory efficacy, and contestability and redirection, together with a minimal tracing requirement. The paper argues that human authorship under generative AI depends not on how many steps a person personally performs, but on whether that person's reasons continuously, reflectively, and effectively shape what the work becomes.
Read the full abstract ▾
Machine Learning
Conformal Calibration Transfer
Achref Doula
Conformal prediction converts point predictions into set-valued predictions with coverage guarantees under exchangeability between calibration and deployment data. We study conformal calibration transfer, where this requirement fails because labeled calibration is available only in a source space, while prediction sets are needed in a target space linked to the source through unlabeled paired observations (e.g., paired modalities or sensor changes). We propose Transported Conformal Calibration (TCC): we transport labeled source calibration into the target space using the paired data, and then correct residual post-transport mismatch using only unlabeled target inputs. We instantiate this correction with two complementary methods: TCC-KS, which uses a label-free uncertainty surrogate to detect mismatch and adjust calibration conservatively, and weighted-TCC, which reweights transported calibration toward the target domain for improved efficiency when weights are stable. We provide finite-sample target-domain coverage guarantees that adapt to an observable measure of mismatch. Across CIFAR-100-C, Tiny-ImageNet-C, and SEN12MS, we show reliable target-domain coverage transfer without labeled target calibration data, with label-free diagnostics that predict when correction is needed.
Read the full abstract ▾
Machine Learning · Cross-listed from quant-ph
A Quantum-Inspired Dequantization Method for Diagonally Weighted Matrix Functions: Application to Learning with Optimized Random Features
Natsuto Isogai, Mio Murao and Hayata Yamasaki
Quantum-inspired classical
algorithms have dequantized several
quantum machine learning routines by replacing
quantum linear-
algebra subroutines with classical counterparts. However, the sampler based on
quantum singular value transformation (QSVT) for learning with optimized random features is not covered by existing dequantization frameworks, because the
matrix to be inverted is not itself available through sampling access. In this work, we develop a classical
algorithm to address this type of
quantum-advantage candidate. Our method samples heavy indices, reduces the transformation to a small principal block, and outputs a sparse classical representation with operator-norm guarantees. Applying this method dequantizes the sampler for optimized random features, giving a classical sampler with prescribed accuracy and polynomially related runtime. These results show that the factorization underlying a
quantum block encoding can itself provide sufficient classical structure even when sampling-and-query access to the composite
matrix is unavailable.
Read the full abstract ▾
Artificial Intelligence
Towards a Deterministic Math Solver for Clinical Language Models
Felipe Ocampo Osorio, Sebastián Andrés Cajas Ordoñez, Maximin Lange et al. (+5 more)
Large
language models are unreliable at arithmetic, which is a problem for clinical calculators where a single numerical error changes the recommendation. The standard response is to hardcode each calculator as a validated function, one at a time. We test an alternative: the model does not calculate. Instead, it writes case-specific Python that a restricted local executor runs as a deterministic solver, and the model's task reduces to deciding how to use it. We evaluate this Program-Solve interface on MedCalc-Bench Verified (1,100 cases, 55 calculators) against direct model arithmetic and a hand-written 22-calculator library, using Qwen2.5-7B and Qwen2.5-32B-AWQ, after
auditing the
benchmark's formulas against current clinical guidelines and flagging 16 of 55 with version, use or coefficient concerns. With formulas and gold variables supplied and both routes reading the whole note, handing off to the solver is not a reliable advantage at 7B (75.31% against 72.02%, a paired +3.29 points with a 95% calculator-cluster interval of [-3.49, 10.38]) but is one at 32B (90.53% against 83.47%, +7.05 [0.47, 14.60], clear of zero). The hand-written library is exact on its 440 supported cases but abstains elsewhere (40.0% overall). Adding an executor thus helps some open-weight models more than others even under matched formula, variable and note access, and is not a substitute for verified formulas or reliable variable extraction either way.
Read the full abstract ▾
All authors Felipe Ocampo Osorio, Sebastián Andrés Cajas Ordoñez, Maximin Lange, Rafi Al Attrach, Sahil Kapadia, Zakaria Laouabdia Sellami, Angelo Antonio Talio, Leo Anthony Celi
Numerical Analysis · Cross-listed from physics.flu-dyn
A Robust All-Mach Six-Equation Diffuse-Interface Method for Multiphase Flows with Surface Tension
Ghanshyam Bharate and J.C. Mandal
A robust finite-volume framework is presented for the simulation of compressible multiphase flows with surface tension across a wide range of Mach numbers. The method is based on a two-pressure, six-equation diffuse interface model incorporating viscous, gravitational, and capillary effects through the continuum surface force formulation. To consistently account for capillary-induced pressure jumps, an HLLC Riemann solver is developed using generalized Riemann invariant analysis, and the instantaneous pressure relaxation procedure is modified to preserve the Laplace pressure jump during phase equilibration. To overcome the excessive numerical
diffusion of conventional approximate Riemann solvers in the low-Mach regime, a robust low-Mach correction is proposed by extending our previous formulation with a modified scaling strategy that remains stable in regions of strong pressure variation. The resulting method retains accuracy from nearly incompressible flows to compressible regimes while preserving the robustness of the six-equation formulation. The numerical framework is validated using a series of
benchmark problems involving surface tension, viscosity,
gravity, and compressibility. The results demonstrate accurate prediction of interface dynamics, capillary pressure, and low-Mach flow features, while significantly reducing numerical dissipation without compromising stability. The proposed methodology provides an efficient and reliable approach for the simulation of complex multiphase flows spanning a broad range of flow regimes.
Read the full abstract ▾
Robotics
When Information is Worth the Risk: Behavioral Valuation for Hazardous Robotic Exploration
Alkesh K. Srivastava, Aamodh Suresh, Carlos Nieto-Granda et al. (+1 more)
Hazardous robotic exploration requires
robots to map spatial risks, such as unsafe terrain, radiation, fire, mines, or structural damage, while operating where collecting information can itself cause failure. A highly informative path may expose the
robot to hazards, terminate execution, and prevent future observations. Hazardous exploration therefore requires deciding not only where uncertainty is largest, but when reducing it is worth the risk. This paper introduces a valuation-layer view of this problem. We keep the belief update, sensor model, physical risk model, and finite-horizon informative planner fixed, and change only the scalar objective used to rank feasible paths. Within this framework, we introduce a risk-augmented Behavioral Information objective based on Prelec probability weighting, yielding an interpretable family of conservative-to-aggressive information-risk valuations. Theoretically, we show that valuation parameters create switching boundaries between high-information/high-risk and lower-information/lower-risk paths, and induce a transformed Pareto-frontier structure over feasible exploration policies. Large-scale failure-truncated grid-world experiments show that valuation alone reshapes the information-risk frontier. Shannon information planning remains a strong raw-information baseline, while risk-aware objectives can reduce hazard exposure and
robot losses by avoiding failures that truncate future sensing. Risk-augmented Behavioral valuation is Pareto-competitive with standard risk-aware baselines and provides interpretable conservative and intermediate regimes. These results support a framework in which
robots reason not only about how much uncertainty an action reduces, but whether that reduction is worth the risk required to obtain it.
Read the full abstract ▾
All authors Alkesh K. Srivastava, Aamodh Suresh, Carlos Nieto-Granda, Philip Dames
Artificial Intelligence
Finishing the Task Is Not Enough: Evaluating Agent Resilience and Considerate Participation under Accumulating Challenge
Yuanchen Bai, Zijian Ding and Angelique Taylor
Sustained deployment of generative AI
agents requires more than isolated task success.
Agents must remain useful across repeated interactions, changing conditions, and dependencies on people within shared workflows, especially as technical, human, and operational disruptions accumulate over time. We propose operational resilience and considerate participation as two complementary aspects of evaluating such
agents: the former captures how
agents recover from blocked work while preserving progress and communicating their limits, and the latter captures how their adaptation accounts for affected people, role boundaries, and the surrounding workflow. Yet both remain underexplored under accumulating challenge. We study 120 simulated healthcare trajectories across two generative AI models and twelve stakeholder-derived tasks under light, medium, and heavy challenge. We compare textual action plans, prompted internal assessments, and quantitative structured workload and affect reports to examine how
agent behavior and reported state change as challenge accumulates. Regarding operational resilience,
agents shift from self-directed recovery toward greater human dependence, while reporting increasing workload and negative affect in structured reports but seldom expressing strain in textual responses. Regarding considerate participation,
agents broaden from task-focused adaptation toward task reframing,
attention to others, role-boundary adjustment, and wider coordination, with distinct patterns across actions and internal assessments. From these findings, we derive five deployment dilemmas involving persistence,
attention, role boundaries, state disclosure, and escalation that require stakeholder specification, further informing technical implications for learning, situated evaluation, and
embodied adaptation.
Read the full abstract ▾
Computer Vision
AcFlow: Controlling Text-to-Image Diffusion Transformers via Learned Conditional Activation Flow
Junran Wang, Zehao Jin, Tianyu Luan et al. (+3 more)
Text-to-image
diffusion transformers (DiTs) are powerful generators, yet direct prompting provides limited control interface for style intensity and can fail to suppress unwanted concepts. To enable these controls, we introduce AcFlow, an inference-time controller that transports intermediate layer image-
token activations through a learned concept-conditioned velocity field while keeping the base DiT frozen. A textual concept description specifies the desired intervention, while the integration horizon provides a continuous control parameter. The field produces
token-varying, activation-dependent updates. With parameters shared across concepts within each task family, one field covers over 15,000 style descriptions or over 1,000 suppression concepts, and generalizes to concepts unseen during training without per-concept fitting. On style control, AcFlow achieves the best style–content trade-off among the evaluated baselines in the high-style-
alignment regime. At a fixed operating point, AcFlow attains style–content
alignment of 0.5365/0.2860, compared with 0.4397/0.2684 for the baseline with the highest style
alignment. On concept suppression, AcFlow reduces the fraction of images showing the concept from 95.3%/82.1% to 41.6%/40.5% on held-in/held-out concepts, including cases where deleting them from the
prompt fails to remove them. Our analyses support the learned velocity field as an adaptive control mechanism, with update directions varying across
tokens and depending on their activation states. Our code is available at https://github.com/Nove1yst/AcFlow.
Read the full abstract ▾
All authors Junran Wang, Zehao Jin, Tianyu Luan, Ruixuan Deng, Tian Qiu, Xinjie Shen
Computation and Language
CMNIE: An Information Extraction Benchmark for Chinese Military News
Yan Yu, Mengna Zhu, Zhenyu Song et al. (+3 more)
Structured extraction from Chinese military news supports intelligence analysis, decision-making, and knowledge base construction. However, existing resources provide limited support for joint informa?tion extraction in this domain, especially when events, event arguments, entities, and relations must be modeled together. We present CMNIE, an information extraction
benchmark for Chinese military news. Extend?ing military-domain resources beyond document-level event annotations, CMNIE jointly annotates event triggers, event arguments, named enti?ties, and entity relations under a unified domain schema. The
dataset contains 13,000 instances collected from public Chinese military news, with manual annotations for 7 event types, 10 argument roles, 7 entity types, and 8 relation types. We evaluate supervised IE models, zero-shot large
language models, and fine-tuned LLM-based extraction methods on a shared test set. Experimental results show that CMNIE remains chal?lenging, especially for relation extraction and exact matching of event?argument spans; zero-shot LLMs often identify relevant semantic units but fail to match gold span boundaries exactly. CMNIE provides a stan?dardized
benchmark for studying schema adherence, exact span match?ing, and joint structured extraction in specialized Chinese news.
Read the full abstract ▾
All authors Yan Yu, Mengna Zhu, Zhenyu Song, Hao Yang, Haiwen Chen, Mao Wang
Computation and Language
NCP-ArchPreview Technical Report: Moving towards Latent Space Language Models through Next Concept Prediction
The Intern-NCP Team: Jiaqi Cao, Chiyu Chen, Shuang Cheng et al. (+24 more)
We introduce NCP-ArchPreview, a latent-space
language model that pushes autoregressive pretraining beyond standard next-
token prediction (NTP). Alongside NTP, the model learns through Next Concept Prediction (NCP) to predict discrete concepts that span multiple
tokens, introducing an explicit and more challenging concept-level objective while preserving standard
token-level autoregressive generation. NCP-ArchPreview builds a latent space by constructing a product-quantized concept vocabulary directly from its hidden states, and subsequently learns to predict future concepts via a dedicated Concept Module. These predicted concepts are then fed back to the
token level to guide subsequent generation, with NTP and NCP trained jointly end-to-end. We scale this architecture to 8.9B parameters and train it on 5.73T
tokens from the Dolma-3
dataset, marking the largest demonstration of a latent-space
language model to date. Remarkably, by consuming only 51.3% of the total training
tokens, NCP-ArchPreview achieves the final pretraining loss of OLMo-3-7B. Following full pretraining, it outperforms OLMo-3-7B by 2.45 points on the downstream macro-average, including a notable 5.99-point gain on GSM8K. Controlled experiments isolate a clear progression of performance gains stemming from both the latent architecture and the NCP objective. Furthermore, utilizing only 85% of the standard computation, NCP-ArchPreview approaches the training loss of a strictly parameter-aligned 8.9B baseline. The learned latent space remains highly valuable after the pretraining stage: updating just the 17M-parameter VQ module yields a novel, lightweight interface for domain adaptation, while a simple injection of concept representations into a DFlash2 drafter improves the mean accepted length by 4.17% with negligible overhead.
Read the full abstract ▾
All authors The Intern-NCP Team: Jiaqi Cao, Chiyu Chen, Shuang Cheng, Xu Cheng, Beiya Dai, Yufan Feng, Kewen Ge, Ruijun Ge, Jiayi Huang, Yang Jiao, Dahua Lin, Zhouhan Lin, Yifan Liu, Yuliang Liu, Biqing Qi, Mowen Ruan, Junzhe Shen, Yunchong Song, Hao Sun, Zhongbo Tian, Yixuan Wang, Rubin Wei, Jiaxin Xiong, Kangyu Yang, Qian Yao, Qi Zhang, Bowen Zhou
Artificial Intelligence · Cross-listed from eess.SP
From Semantic to Token Communication: The Next Paradigm for Large-Model-Driven 6G Intelligent Connectivity
Yu Ma, Zhen Gao, Li Qiao et al. (+11 more)
The ambitious requirements of sixth-generation (6G) networks are driving communication systems from reliable bit delivery toward meaning-aware and task-oriented connectivity. Large models (LMs), with strong
multimodal understanding and generation capabilities, have accelerated this shift and made semantic communication (SemCom) increasingly practical. Yet current LM-driven SemCom remains fragmented: semantic representations are typically tied to specific modalities, models, or tasks. While the bit provides a universal unit for digital transport, there is still no analogous unit for representing and processing semantics, which limits interoperability, theoretical unification, and scalable system design. We argue that
tokens provide a natural candidate for this missing abstraction. Two trends support this: unified
multimodal LMs now encode text, images, audio,
video, and
robot actions in one
token space, while distributed LM inference already generates substantial
token-level traffic through expert routing, cache transfer, and speculative decoding.
Token communication (TokenCom) emerges by unifying these trends, using the LM's native processing unit as a communication abstraction above the bit level and enabling importance assignment, error handling, and resource allocation directly at
token granularity. This survey traces the
evolution from LM-driven SemCom to TokenCom. We review three major directions of LM-driven SemCom: source-centric semantic coding, channel semantics for physical-layer tasks, and collaborative edge-device intelligence. We then examine the
token abstraction, the transmission techniques it requires, and two emerging paradigms, namely TokenCom for LM services and for
embodied and agentic intelligence. Finally, we identify open challenges toward unified, scalable, and AI-native 6G communication systems.
Read the full abstract ▾
All authors Yu Ma, Zhen Gao, Li Qiao, Xiaoyuan Zhang, Mahdi Boloursaz Mashhadi, Yin Xu, Wenjun Xu, Xiaodong Xu, Kaibin Huang, Jiangzhou Wang, Rahim Tafazolli, Sheng Chen, Tony Q. S. Quek, Ping Zhang
Artificial Intelligence
An Open Recipe for IMO Gold: Training Nemotron for Olympiad Mathematics
Ivan Moshkov, Stephen Ge, George Armstrong et al. (+3 more)
We study how model post-training and test-time inference design affect natural-
language proof generation for hard olympiad mathematics. Starting from Nemotron 3 Ultra, we train two specialist checkpoints using supervised fine-tuning and reinforcement learning, and evaluate checkpoint choice, verification, and refinement. Based on these findings, we present an open-model test-time-compute pipeline. The system operates entirely in natural
language, with no formal prover, external tools, or internet access. Three Nemotron 3 Ultra checkpoints - the general-availability model and two post-trained specialists - power an iterative search that generates, verifies, and refines candidate proofs; a separate high-compute stage then selects each final submission. The system scored 30 out of 42 points at IMO 2026, reaching the gold-medal threshold. We release the two post-trained checkpoints as well as the training data, the training and inference code, the submitted solutions, and Nemotron-IMO-Bench, a new
benchmark of 200 novel olympiad-level problems.
Read the full abstract ▾
All authors Ivan Moshkov, Stephen Ge, George Armstrong, Wei Du, Sadegh Mahdavi, Igor Gitman
Cryptography and Security
Architecting the Secure AI-SOC: A Neurosymbolic Framework for Pipeline Integrity and Threat Mitigation
Anna Gazani, Spyridon Kounoupidis, Panagiotis Katsaros et al. (+3 more)
The integration of Large
Language Models (LLMs) into Security Operations Centers (SOCs) streamlines threat intelligence but introduces critical vulnerabilities, notably indirect
prompt injection via log poisoning. Adversaries exploit this vector to execute multistep “promptware” kill chains by
embedding malicious payloads within system logs to hijack the LLM's operational logic. Securing this pipeline presents a dichotomy: deterministic defenses are computationally efficient yet semantically blind, while purely neural evaluations introduce prohibitive latency and probabilistic flaws. To address this, we propose a novel neurosymbolic defense-in-depth architecture that ensures end-to-end pipeline integrity. The primary layer employs customized SIEM decoders as a deterministic pre-filter, performing immediate structural sanitization to neutralize volumetric padding and signature-based injections at the ingestion edge. The secondary layer leverages NeMo Guardrails to enforce strict semantic boundaries through self-checking validation on the structured SIEM alerts prior to LLM processing. Furthermore, the framework integrates a closed-loop telemetry system, providing critical Human-in-the-Loop (HITL) visibility into thwarted attacks directly within the SOC dashboard. We present a comprehensive experimental evaluation mapped to the MITRE ATLAS taxonomy, assessing the framework against diverse
prompt injections. Our results demonstrate that this synergistic approach effectively dismantles the promptware kill chain - bounding LLM stochasticity with verifiable constraints, and delivering a resilient, highly observable defense mechanism for next-generation AI-SOCs.
Read the full abstract ▾
All authors Anna Gazani, Spyridon Kounoupidis, Panagiotis Katsaros, Nikolaos Kekatos, Grigorios Tsoumakas, Georgios Koutidis
Robotics
HuRo: Robotizing Human Videos for Scalable VLA Pretraining
Jinho Jeong, Se June Joo, Jaehyun Kang et al. (+4 more)
Human
video datasets offer an abundant and diverse source of interaction data that can complement expensive real-
robot data. To bridge the human-to-
robot embodiment gap, existing approaches either robotize
videos in task-matched settings or address observation and action
alignment separately. In this work, we systematically examine whether robotized human
videos can serve as an effective and scalable source of
robot-aligned supervision. To this end, we develop a robotization pipeline that converts heterogeneous human
videos into
robot-aligned observations and action trajectories while inferring missing intermediate signals across annotation levels. Using this pipeline, we construct the HuRo
dataset, comprising about 630K robotized episodes and 142M processed frames from five human-
video sources. Across four real-world manipulation tasks, pretraining a VLA policy on increasing amounts of robotized human-
video data improves overall completion from 51.5% to 80.3% and OOD completion under spatial and visual shifts from 34.9% to 72.2%. Ablations further show that visual robotization improves OOD robustness and that end-to-end pretraining with retargeted actions outperforms visual-only transfer. Project website: https://3587jjh.github.io/HuRo.
Read the full abstract ▾
All authors Jinho Jeong, Se June Joo, Jaehyun Kang, Dongyun Kim, Yena Kim, Hanjung Kim, Seon Joo Kim
Computational Engineering
A Penalty-Aware, Blockchain-based Cloud Monitoring System
Christian Dienbauer, Benedikt Pittl and Erich Schikuta
Today, traded cloud services are governed by service-level agreements that specify providers' obligations, such as availability and reliability. Violations of service-level agreements result in penalty payments. The recent development of prominent cloud platforms, such as the redesign of Amazon's spot marketspace, underpins a trend towards dynamic cloud
markets where consumers continuously migrate their services across different marketspaces and providers to reach a cost optimum. This leads to a heterogeneous IT infrastructure and, consequently, complicates monitoring of delivered service quality. Hence, there is a need for a transparent penalty management system that ensures consumers automatically receive penalty payments from providers for service violations. In this paper, we present a cloud monitoring system that can autonomously execute penalty payments. In this regard, we use smart contracts hosted on blockchains that continuously monitor cloud services and trigger penalty payments to consumers in the event of service violations. For justification and evaluation, we implement our approach using the IBM Hyperledger Fabric framework and create a use case with Amazon and Azure cloud services to illustrate the universal design of the presented mechanism.
Read the full abstract ▾
Computation and Language
Data-Efficient Language Modeling: From Frontier Advancement to Principle-Guided Model Improvement
Shuxing Yang, Kaihao Zhu, Junjie Yang et al. (+13 more)
Learning from limited text requires models to use context, generalize to new inputs, and retain useful capabilities. Qiushi Engine conducted a long-horizon, end-to-end autonomous research program on BabyLM 2026 Strict-Small, within 10 million corpus words and 100 million cumulative word presentations. Three stages connected frontier advancement, principle discovery, and principle-guided model improvement. Stage I combined compact restatements, budget reinvestment, and residual incremental learning to build a frontier model. Stage II found that exact repetition and aligned restatement produce different patterns of context use, depending on target relations and prediction windows. In controlled tasks, recovering familiar performance did not ensure that unseen inputs could still use learned computations. These findings support a testable data-efficient learning principle: organize experience around the contextual dependencies needed for prediction; separately design visible information, supervision, and preservation; test learning, generalization, and retention. Stage III retained source text, masked more local clues, supervised selected targets, and preserved predictions on ordinarily masked inputs. Two continuation seeds from the same parent outperformed ordinary continuation on the complete nine-metric aggregate. Overall rose from 42.02 to 42.25 across two generations; the second achieved the highest Overall in the public Strict-Small snapshot of 8 September 2026. Further studies addressed compression, relational anchors, shared representations, and measurement. Models are available on Hugging Face; code and research records accompany the GitHub repository. Together, these stages illustrate Research RSI: recursive self-improvement of the research process. Scientific understanding and method innovations change subsequent questions and designs; new experiments test and refine them.
Read the full abstract ▾
All authors Shuxing Yang, Kaihao Zhu, Junjie Yang, Rui Zhao, Junyao Wu, Yize Wang, Wenhao Li, Fujia Chen, Taowen Deng, Shenzhan Hong, Yaqi Li, Zichen Li, Jincheng Mi, Yuang Pan, Hongsheng Chen, Yihao Yang
Computation and Language · Cross-listed from astro-ph.IM
More than half of recent astronomy papers are written with language-model assistance
Serat M. Saad and Yuan-Sen Ting
Language models leave a distinctive vocabulary in the prose they help write, and we measure how much of the astronomy literature now carries it. From the full text of 207,111 astro-ph papers spanning 2015 to mid-2026, we count those words in each paper and model the counts, in proportion to paper length, as a mixture of assisted and unassisted writing in a hierarchical
Bayesian model. Papers from before 2020 calibrate the unassisted rate, and the 392 papers that disclose model use calibrate the assisted one. Our answer depends on how often these words would appear today if nobody used a model, a rate that must be modeled rather than observed, so we extend it past 2020 under three assumptions and report all three. For 2025 that gives $54^{+8}_{-8}\,(\mathrm{stat},\,95\%)\,^{+26}_{-0}\,(\mathrm{sys,\ background})$% of papers, the second error being the spread across the three. The estimate stays at or above 36% when we vary that choice, the calibration, and the requirement that adoption only rises. A word list built from the astro-ph corpus, keeping only words that rose across every subfield, leaves 2025 in the same range. Assisted writing is also getting harder to see, since authors adapt to the words that reveal it and the marker excess more than halves between 2023 and 2026. Our model allows for that fading, so it can separate a fainter trace from reduced use. More than half of recent astro-ph papers therefore carry a
language-model trace, while only 0.81% of 2025 papers disclose it, one declaration for every $\sim$66 papers with a trace.
Read the full abstract ▾
Machine Learning
GEOSTEER: Geodesic Optimization for Activation Steering in Large Language Models
Xuan Cuong Ngo, Hao Vo and Ngan Le
Activation steering provides a lightweight way to control large
language models (LLMs) by modifying their hidden activations at inference time. Among these approaches, norm-preserving steering aims to change model behavior without altering the activation norm, reducing the risk of representation collapse and degradation. However, existing norm-preserving methods are limited by predefined steering trajectories and by their reliance on one-step updates, which may fail to capture the complex structure of activation distributions. We propose GeoSteer, an optimization-based method for norm-preserving activation steering. GeoSteer formulates steering as a Riemannian optimization problem and updates activations through a sequence of small geodesic steps on the representation
manifold. To avoid fixed steering directions, GeoSteer learns a nonlinear activation-space objective that distinguishes desired from undesired activations, and uses this function to adaptively guide each steering step. This multistep formulation yields smoother, more stable, and more consistent steering behavior while preserving the activation norm. Across TruthfulQA, RealToxicityPrompts, and UltraFeedback
benchmarks, GeoSteer consistently improves over state-of-the-art activation steering baselines. These results suggest that norm-preserving steering can be made more effective by replacing predefined one-step edits with adaptive, geometry-aware optimization.
Read the full abstract ▾
Artificial Intelligence
Quantifying the Memorization-to-Generalization Transition: Scaling Laws and Phase Structure in Grokking
Anish Kataria
Neural networks trained past memorization frequently undergo a delayed transition to generalization, a phenomenon known as grokking. Despite theoretical progress on why this transition occurs, the quantitative structure of when it occurs in hyperparameter space remains uncharacterized. We map the memorization-to-generalization boundary across 384 configurations of two-hidden-layer MLPs on modular arithmetic, fitting a power-law scaling relation for generalization onset time: $T_{\mathrm{grok}} \propto H^{-0.27}\, D^{-2.04}\, \eta^{-0.50}\, \lambda^{-0.64}$ ($R^2 = 0.732$; $0.821$ with interactions). The exponent hierarchy reveals that data complexity ($D^{-2.04}$) is the dominant driver of regime transition, not model capacity ($H^{-0.27}$): doubling data accelerates generalization by ${\sim}4\times$, while doubling width yields only ${\sim}1.2\times$. A sharp phase boundary at weight decay $\lambda \gtrsim 1.0$ separates grokking from non-grokking configurations, and weight norm trajectories show monotonic compression during the transition, consistent with implicit regularization selecting low-complexity solutions. These results provide a quantitative foundation for predicting and controlling regime transitions in overparameterized networks.
Read the full abstract ▾
Artificial Intelligence
Understanding LoRA Rank Trade-offs in Diffusion Model Fine-Tuning
Iman Khazrak, Narges Nejad, Mostafa M. Rezaee et al. (+1 more)
Selecting LoRA rank for
diffusion fine-tuning requires balancing quality and compute cost. We present a controlled study on CIFAR-10 using a DDPM U-Net with ranks {2,4,8,16,32}, fixed optimization settings, and a reproducible local-folder pytorch-fid protocol. We report FID, trainable parameters, runtime, and GPU
memory, then validate trends with extended-budget DDPM runs (20 epochs; ranks 4/8/16) and a Tiny DiT backbone (10 epochs; ranks 4/8/16). Results show moderate ranks are most efficient: rank 4 achieves the best DDPM FID (124.1380), rank 8 is close (124.2136), and higher ranks provide limited gains despite larger adaptation cost. These findings support small-to-moderate ranks as practical defaults under fixed training budgets.
Read the full abstract ▾
All authors Iman Khazrak, Narges Nejad, Mostafa M. Rezaee, Robert C. Green II
Artificial Intelligence
A Multi-Stage Rule-Chaining Framework for Compositional and Interpretable Cognitive Reasoning
Deblina Kar
The Abstraction and
Reasoning Corpus (ARC)
benchmarks cognitive generalization, the ability to infer and apply abstract rules from limited examples. This paper presents a multi-stage rule-chaining framework that performs compositional
reasoning across symbolic, structural, and conceptual levels. The framework integrates three complementary solvers: (1) a deterministic rule discovery module that induces atomic transformations through
geometric, color, and object-based analysis; (2) a pattern-composition engine that reconstructs outputs via block merging, repetition, and spatial heuristics; and (3) a structural abstraction layer that infers hierarchical and nested relationships across grids. These solvers operate sequentially within a progressive fallback hierarchy, where each stage reuses prior
reasoning traces to enhance interpretability and generalization. Training passed for 995 tasks out of 1000, further evaluated on 105 tasks out of 120 and solved 230 test tasks out of 240 ARC-AGI-2 tasks. The system achieved strong coverage across deterministic, compositional, and abstract categories, demonstrating an overall accuracy exceeding 95 percent. The proposed architecture bridges symbolic
reasoning and pattern synthesis, providing interpretable insight into cognitive generalization. The results suggest that rule chaining and hierarchical composition can advance machine
reasoning toward transparent, human-aligned abstraction without relying on task-specific tuning.
Read the full abstract ▾
Machine Learning
Artificial Intelligence Algorithms for the Detection of Pathologies Related to Lung Cancer through Image Analysis using Convolutional Neural Networks and Data Augmentation: a systematic mapping of the literature
Pablo Ramirez Amador
Lung cancer is one of the leading causes of death worldwide, and its early diagnosis is crucial to improving patients prognosis and quality of life. However, the process of interpreting medical images for the detection of lung cancer is complex and requires trained experts. In this context, artificial intelligence (AI) and deep learning (DL) emerge as potential tools to automate and optimize image analysis. The objective of this work is to review the most recent and relevant applications of AI and DL in the field of radiology for the detection of lung cancer. To this end, an exhaustive search was carried out in scientific databases such as PubMed,IEEEXPLORE, Scopus and Web of Science, and 96 articles published from 2015 to the present addressing the use of AI and DL in biomedical engineering were selected. Emphasis is placed on the use of convolutional neural networks (CNN) with transfer learning and Data Augmentation as promising techniques to improve the accuracy and efficiency of the image interpretation process. The results show that the use of AI and DL can offer an effective alternative for the early diagnosis of lung cancer, with high sensitivity and specificity. However, current limitations and challenges that must be addressed to guarantee its responsible and safe application in clinical practice are also identified, such as the lack of standardized data, the ex plainability of the models, patient
privacy, and the ethical and social implications. It is concluded that the use of AI and DL can have a positive impact on the care of patients with lung cancer, but further research and regulation are required to ensure its quality and reliability.
Read the full abstract ▾
Software Engineering
Governed Human-AI Prioritization Under Uncertainty: Adaptive Estimation and Dependency-Constrained Portfolio Selection
Azzeddine Ihsine and Sara Ihsine
AI-native software engineering increasingly combines human judgment, historical analogy, parametric estimation, and AI-generated forecasts in the same prioritization decision. We study five quantitative operators used in the D-POAF decision practice and stress-test them under uncertainty,
estimator dependence, drift, shared context error, dependencies, and limited capacity. Robustness extensions use 30 deterministic seeds. Moderate scoring changes preserve broad order while materially changing funded-set membership. Under independent
estimator errors, inverse-MSE aggregation reaches MAE 0.615, a 42.2% reduction relative to the best individual
estimator. The gain falls to 4.4% at error correlation rho = 0.6 and becomes negative at rho = 0.8, while calibration-set regression remains slightly better than the best individual and approaches a test-set oracle. Under
estimator drift, four-Wave adaptive weighting reduces average RMSE by 4.64% (95% CI [4.50%, 4.78%]). Model-collective divergence achieves ROC-AUC 0.908 with independent channels and remains above 0.878 with shared noise up to 0.8. We separate budget-constrained portfolio selection from ODP's native dependency-aware sequencing role. When ODP distance is repurposed as a portfolio-selection heuristic, value-to-effort is stronger in the tested generator. For a fixed selected set, ascending ERS/BVS is optimal for an ERS-weighted completion objective without dependencies and reaches mean efficiency 0.982 versus the exact precedence-constrained optimum at dependency intensity lambda = 1.0. Scaling to 100 Feature Blocks, ODP has the highest mean early-value AUC among the transparent sequencing baselines, with a small margin over PVS ordering. These results characterize both the validity region of evidence-weighted human-AI prioritization and the boundary between selection and sequencing objectives.
Read the full abstract ▾
Machine Learning
Byzantine-Robust Federated Fire Detection with a Rotating Coordinator
Georgia Argyrou, Aymen Bahroun, Hedi Fendri et al. (+1 more)
We study the application of
federated learning (FL) to indoor fire detection. Such fire-detection systems use edge cameras that record sensitive footage which cannot easily be collected at a central server. Existing
federated solutions leave three practical obstacles unaddressed: limited uplink bandwidth, Byzantine (malicious or faulty) clients, and unconditional trust in a single, permanently fixed aggregation server. Our main contributions address all three. In particular, we provide (i) a curated indoor fire-detection
dataset assembled from eight public sources; (ii) an edge-deployable detector whose model updates are compressed up to 10 times with only a small loss in balanced accuracy; and (iii) a semi-decentralized Byzantine-robust FL method that combines history-aware aggregation with a rotating coordinator, evicting stealthy attacks that per-round filters miss while removing the fixed-server single point of failure. On the held-out test set the rotating-coordinator method matches its fixed-server counterpart in accuracy and detection speed, and a physically distributed six-node cloud deployment confirms feasibility.
Read the full abstract ▾
All authors Georgia Argyrou, Aymen Bahroun, Hedi Fendri, Alexander Jung
Sound
Sparse Weight and Edge Circuit Discovery in Transformer-based Acoustic Models
Jiankun Wei, Ewan Dunbar and Gerald Penn
Transformer-based foundation models are powerful but opaque, motivating Mechanistic Interpretation methods to uncover the black-box by identifying small computation subgraphs responsible for a task. DiscoGP is a joint weight-and-edge
circuit discovery framework originally developed for text decoders. We extend DiscoGP to
speech encoders and present, to our knowledge, the first
circuit discovery study for modern
speech foundation models. Across HuBERT and Wav2Vec 2.0 on several
speech classification tasks, we find that the discovered
circuits are extremely compact, yet often match or even exceed the performance of the full pretrained encoder with the same downstream head. Through ablations, we show that these
circuits reflect pretrained computation rather than random structure or task-head artifacts. We also introduce a
memory-efficient DiscoGP variant that reduces the GPU
memory cost of edge-
circuit discovery at runtime from quartic to cubic. Overall, our results broaden Mechanistic Interpretation beyond text decoders and show that
circuit-level analysis can reveal both explanatory structure and unexpected functional behavior in
speech encoders.
Read the full abstract ▾
Machine Learning · Cross-listed from q-bio.BM
Sequence-Informed Geometric Evaluation of RNA 3D Structures
Andrea Zerio, Yighua Yao, Alessandro Micheli et al. (+5 more)
Computational RNA structure pipelines generate many candidate conformations for the same sequence. Reliable evaluation therefore requires more than recognising plausible geometry, it requires determining whether that geometry is compatible with the sequence. We introduce SIRGE, a sequence-informed
geometric evaluator that conditions structural representations on nucleotide
embeddings from a pretrained RNA
language model. Early results show that SIRGE outperforms established evaluators in Kendall–$\tau$
alignment, Top-1 selection, and Top-3 ranking. Controlled comparisons further show that sequence conditioning corrects errors made by an otherwise matched
geometric model and improves target-level rank structure. These findings provide initial evidence that pretrained sequence representations supply ranking information that complements
geometric reasoning.
Read the full abstract ▾
All authors Andrea Zerio, Yighua Yao, Alessandro Micheli, Roland G. Huber, Mile Sikic, Samir Bhatt, Andres R. Masegosa, Yuangang Pan
Machine Learning
Zero-shot rib design: merging training-free generative prior with topology optimization
Yongmin Kwon and Namwoo Kang
Natural load-bearing patterns such as leaf venation, trabecular bone, and spider webs achieve high stiffness per unit mass, yet classical
topology optimizers rarely reach such geometries, and few let engineers express structural design intent through natural
language. This work treats a frozen text-to-image
diffusion model as a training-free source of design knowledge and distills it into the physics loop of density-based
topology optimization via score
distillation sampling, so that a text
prompt becomes an explicit, machine-interpretable representation of engineer intent. The
prompt-induced generative gradient and the finite element sensitivity are combined at every iteration, letting physics decide which
prompt-induced features survive. In 245 primary SDS runs spanning four
geometric domains and two physics regimes, 38 of 49
prompt–domain combinations achieved statistically significant compliance reductions (up to $-31.5\%$ mechanical and $-23.0\%$ thermoelastic), outperforming gradient-based baselines. Cross-domain morphological analysis identifies a recurring structural signature of improvement: in most domains the generative prior suppresses dead-end branches in the rib skeleton, with endpoint–compliance correlation $r = +0.56$ to $+0.99$. A Heaviside projection with $\beta$-continuation resolves a pronounced intermediate-density tendency in this
diffusion–physics coupling ($42.6\%$ to $<3\%$), and an automated skeleton-based pipeline converts optimized density fields into \rev{candidate geometry ready for computer-aided design. By retargeting the generative prior across domains, loading conditions, and physics objectives through a change of text
prompt, with each new problem's physics setup specified separately, the framework uses a pretrained generative model as a reusable, training-free prior for engineering design.
Read the full abstract ▾
Data Structures and Algorithms
A Deadline-Driven Algorithm for Polyamorous Scheduling
Arjun Maneesh Agarwal
In Polyamorous Scheduling Problem, we are given an edge-weighted graph and must find a periodic schedule of matchings in this graph which minimizes the maximal weighted waiting time between consecutive occurrences of the same edge. This NP-hard problem generalises Bamboo Garden Trimming and is motivated by the need to find schedules of pairwise meetings in a complex social group. We present a $4 G^*$
algorithm for Polyamorous Scheduling, improving the previously known bound of $3 + \sqrt{5} \approx 5.236$. Our
algorithm is inspired by the Deadline-Driven Heuristic which is optimal for Bamboo Garden Trimming (BGT).
Read the full abstract ▾
Numerical Analysis
Vectorial lattice Boltzmann solver for compressible inviscid flows with generic equation of state
S.A. Hosseini and I. V. Karlin
We develop a vectorial
lattice Boltzmann model with a space-time adaptive relaxation coefficient, combined with adaptive time-stepping for compressible Euler dynamics with generic equation of state. The model, due to special form of the relaxation coefficient devised here is shown to converge to the Euler limit with second-order accuracy in the absence of shocks under acoustic scaling. The solver is robust and able to properly capture compressible gas dynamics for both ideal and non-ideal equations of state, including the Bethe–Zel'dovich–Thompson regime. This is verified and demonstrated through a variety of configurations of increasing complexity.
Read the full abstract ▾