Statistical Methodology
Papers
Fresh from arXiv, typeset properly. Highlighted words trade on the market.
All of arXiv
Monday 28 September
Linear mixed-effect panel data models are widely used in longitudinal biomedical, environmental, and social studies, but are often sensitive to data contamination and numerous covariates. To address these challenges, we propose a robust variable selection approach based on a least squares approximation (LSA) of the density power divergence (DPD) objective function combined with the Adaptive LASSO penalty. The LSA converts the nonlinear DPD objective into a computationally efficient quadratic approximation while preserving the robustness of DPD estimation. Under suitable regularity conditions, the proposed DPD Adaptive LASSO-LSA estimator is shown to possess oracle properties, including selection consistency and asymptotic normality. Simulation studies demonstrate improved robustness, better sparsity recovery, and significantly enhanced computational efficiency than penalized likelihood methods, while maintaining performance comparable to existing DPD-based approaches. An application to the SWAN bone mineral density dataset illustrates the practical relevance of the proposed methodology for robust estimation and reliable identification of important covariates.
Machine Learning
ZeroCode: On-demand Error-Correcting Code Construction from the Zero Matrix via Reinforcement Learning
Error-correcting codes (ECCs) are essential across diverse applications, from wireless communications and storage to quantum computing, yet each application imposes distinct design requirements on the parity-check matrix (PCM). To address these on-demand requirements in a unified framework, we propose ZeroCode, a reinforcement learning (RL)-based approach that constructs PCMs sequentially from the all-zero matrix. ZeroCode formulates construction as a discrete sequential decision-making problem and uses proximal policy optimization with action masking to select valid edges. ZeroCode achieves a gain of approximately 1 dB over the prior RL-based construction method at a bit error rate (BER) of $10^{-4}$ for the (32,16) code and outperforms existing genetic, differentiable, and classical code-design methods in our experiments. Beyond optimizing decoding performance, the masking mechanism allows on-demand structural constraints, such as a maximum degree, 4-cycle-free structure, and quasi-cyclic structure, to be flexibly incorporated. Moreover, a single policy rollout yields a library of PCMs with varying edge counts, offering trade-offs between decoding performance and complexity without retraining. Overall, ZeroCode addresses diverse code-design requirements within a unified framework, providing solutions with optimized decoding performance under given constraints.
Read the full abstract
Machine Learning
Rotated Manifold Optimization for Low-Rank Adaptation
We propose a novel optimizer for low-rank adaptation (LoRA) that explicitly incorporates the gauge symmetry of low-rank factorization. Our optimizer extends recent matrix optimizers for full-parameter training to the manifold of fixed-rank matrices by interpreting them as normalization under a rotated basis. We show how rotation and normalization can be integrated with the fixed-rank manifold efficiently. Our optimizer converges faster to lower held-out loss and achieves better or comparable downstream performance on both supervised finetuning and reinforcement learning tasks.
Read the full abstract
Hardware Architecture
Improving Indirect Branch Prediction in Interpreters via Hardware/Software Co-Design
Interpreters have a large indirect-branch footprint, requiring large predictor capacity for accurate prediction. We propose a hardware/software co-design in which a hardware lookahead engine, running ahead of the pipeline with software-provided bytecode metadata, supplies interpreter dispatch targets to the frontend. The engine requires only 1.3 KB of on-chip storage and changes to about 50 lines of CPython code. On 15 CPython server workloads, a 14 KB ITTAGE augmented with the engine reduces bytecode jump MPKI by 73.7% relative to a 16 KB ITTAGE baseline, yielding a 3.2% harmonic-mean IPC speedup.
Read the full abstract
Artificial Intelligence
Maintaining Benchmarks Against Increasingly Capable Agents: Detection and Remediation of Unearned Passes
Agentic benchmarks guide model selection and training. Yet an agent can pass a task without demonstrating the intended capability. Such outcomes constitute unearned passes; their proportion among all passes defines the integrity gap. As agents improve, benchmark surfaces that once seemed harmless can become exploitable, making benchmark validity an ongoing maintenance problem. We introduce a process-verification framework that audits passing trajectories, distinguishes evidenced reward hacking from verifier weakness, and localizes exploitable surfaces for repair. Across 3,810 passing trajectories from 29 model-benchmark cohorts, confirmed violations often increase with model generation but not monotonically. On SWEBench Pro V1.0, confirmed violation rates rise from 24% to 73% between Opus 4.7 and Fable 5 on matched tasks; later cohorts fall to 11% for Fable 5.1 and 0% for GPT-6 Astra. These comparisons are descriptive: configurations were not normalized, and the latest models also pass fewer exploitable tasks. Violations concentrate around a small set of recurring surfaces, especially unintended access to reference solutions through git history. Three repair case studies across two benchmarks show why blocking a recorded exploit is insufficient: the same protected information can remain accessible through another route. Therefore, we combine minimal patches with exploit replay and fresh agent evaluation, auditing new passes under the original standard. No evaluated attempt against the final patches reached the protected channel, and every post-patch pass was judged legitimate. Benchmark integrity requires ongoing maintenance: audit passing behavior, repair the enabling surface, and re-evaluate both exploit access and legitimate solvability.
Read the full abstract
Robotics
RoboICL: Embodied In-Context Learning with GPT-6 Astra
General-purpose vision-language models offer a promising way to zero-shot robot control: \gptastra{} excels at open-ended and language- or image-conditioned manipulation but remains substantially weaker on high-precision and long-horizon tasks. We introduce RoboICL, an in-context robot-control framework that narrows these gaps without robot-specific parameter updates or a learned VLA. RoboICL separates demonstration context, which provides recorded examples when available, from interaction memory, which accumulates the model's own actions and observed outcomes. Both use a shared observation–action–receipt–observation grammar. To preserve experience across task stages, RoboICL combines sampled demonstration blocks with bounded anchored memory. Fixed anchors keep earlier rollout interactions available for in-context learning, while the latest interaction supports immediate error correction. Across 30 RoboDojo tasks, using zero shot for Open and one demonstration elsewhere, RoboICL improves on official zero-shot \gptastra{} by 20–27 progress-score points in every category. It leads the leaderboard baselines on Memory and Open, achieves comparable performance to the strongest Precision baseline, and remains competitive on Long-Horizon. Its 30-task Overall score is 50.64, versus 33.68 for the strongest baseline. On a separate ten-task subset, RoboICL scores 60.60, within 2.00 points of the $\pi_{0.5}$ + \gptastra{} hybrid approach. On three real-robot tasks, mean progress rises from 14.45 at zero shot to 63.33 at one shot and 78.89 at three shots. On two development tasks, optional Jev-gated action reuse reduces \gptastra{} calls by 33–48%. Code is available at \href{https://github.com/Mosi-AI/RoboICL}{https://github.com/Mosi-AI/RoboICL}.
Read the full abstract
Combinatorics
Matching algebras and their Dunkl subalgebras
For a finite simple graph $G = (V, E)$, we consider the quotient algebra $\mathcal M(G)$ of the polynomial ring in the variables $u_e$ (for $e \in E$) by the ideal generated by all products $u_e u_f$ for non-disjoint edges $e$ and $f$ (including all squares $u_e^2$). This quotient is called the matching algebra of $G$, since it has a basis indexed by the matchings of $G$. In this quotient, we define a subalgebra $\mathcal D(G)$ generated by the signed incidence sums $\theta_v=\sum_{e=(v,w)}u_e-\sum_{e=(w,v)}u_e$ for all $v \in V$ (where all edges of $G$ are oriented arbitrarily); we call this the Dunkl matching algebra. We show that, as a graded vector space, $\mathcal D(G)$ is dual to the span of all polynomials $p_M = \prod_{(i,j) \in M} (x_i - x_j)$, where $M$ ranges over all matchings of $G$. For the complete graph $K_n$, the latter span is a direct sum of two-row Specht modules (one in each degree); thus its Hilbert series is that of the Catalan triangle, and, in characteristic zero, the Dunkl matching algebra can be presented by linear and quadratic relations. For arbitrary graphs, we formulate the saturation problem of deciding when the selected matching Specht generators $p_M$ in a given degree $k$ span the full two-row Specht module $S^{(n-k,k)}$. We show that saturation in degree $k$ forces $k$-connectivity, that saturation in degree $2$ is equivalent to $2$-connectivity, and that $k$-linked graphs are saturated in degree $k$. We also prove saturation in every possible degree whenever the complement of $G$ is a matching. We show that the Dunkl matching algebra equals the full matching algebra exactly for forests, and give an explicit Hilbert series formula for unicyclic graphs.
Read the full abstract
Artificial Intelligence
QuantaSpike: Short-Window Spike-Driven Quantization for Large Language Models
Large language models (LLMs) achieve strong performance across many tasks but rely on dense multiply-accumulate (MAC) operations during inference, resulting in high energy cost. Spiking neural networks (SNNs) offer an event-driven alternative in which synaptic integration uses lightweight accumulation. However, spike-driven LLM inference remains difficult because outlier-heavy activations typically require long firing windows or auxiliary non-spiking paths. We propose QuantaSpike, a short-window spike-driven quantization framework for LLMs built around Logarithmic Ternary Integrate-and-Fire (LTIF) neurons. LTIF uses ternary events with power-of-two membrane-response quanta, improving the information represented by each firing step while retaining shift-ACC-compatible computation. QuantaSpike combines this neuron with group-adaptive gain and selective outlier admission: normal values use residual LTIF steps, whereas admitted outliers receive one additional onset spike before entering the same residual dynamics. Across OPT and Llama-2, QuantaSpike achieves state-of-the-art or competitive perplexity and zero-shot accuracy among spike-driven LLM quantization methods. It also transfers to newer dense LLMs, remaining close to the FP16 reference on Llama-3-8B and Qwen3-8B under the same four-step firing window. Analytical linear-energy projections show that QuantaSpike reduces the energy of one linear transformation by about $80.0\%$ on OPT models and $67.1\%$ on Llama-2 models relative to SpikeQuant, providing an accurate and energy-efficient spike-driven path for LLM inference.
Read the full abstract
Computers and Society
Investigating Human–AI Discrepancies via Multiple-Solution Problems
Frontier artificial intelligence (AI) models are benchmarked on whether they reach a correct answer. Yet many problems admit several correct answers and repeated attempts, by different people or by the same model resampled, trace out a distribution over them. In this work, we ask whether human and model reasoning lead to different distributions over valid solutions. Our testbed comprises 270 reasoning puzzles across five puzzle families. These multiple-solution puzzles each have 3 to 8 valid solutions and are simple enough that humans and models can solve them reliably. The resulting distributions differ markedly: models differ from one another, yet resemble each other far more than they resemble humans. Model distributions are, moreover, within every puzzle family, less diverse than human ones. We compare these discrepancies across puzzle categories, and trace how they respond to reasoning-effort settings, to prompting, and to perturbations of the puzzle that leave its solutions unchanged. Together, these results point at significant differences between human and AI problem-solving processes, and their choice among equally defensible solutions. As progressive deployment of AI systems in society comes into focus, evaluating such differences (beyond one-dimensional accuracy metrics) is increasingly important. Data and code are available at https://hai-discrepancies.github.io/
Read the full abstract
Computation and Language
Recursive LLM Degradation in Biomedical Question Answering: A Cross-Generation Study
Repeatedly training language models on their own generated data may create a synthetic-data feedback loop in which errors and distributional biases are reintroduced into subsequent training datasets. This paper studies that process in biomedical question answering (QA) using PubMedQA and two Qwen2.5 model sizes, 0.5B and 3B parameters. The study compares a recursive synthetic-data condition, in which generation G(k+1) is trained on answers produced by G(k), against a Human-Control condition that repeatedly uses the original human training data. The study evaluates across four generations from G0-G3 with two random seeds (42 and 123) and a fixed evaluation set of 1,000 expert-labeled samples. The evaluation includes disease and chemical entity F1, context-supported rate, lexical and semantic similarity, answer length, repetition rate, and other evaluation metrics. The Recursive condition for both model sizes and both seeds showed larger declines than the Human-Control condition in disease entity F1, chemical entity F1, context-supported rate, ROUGE-L, and cosine similarity. Under the fixed no-repeat 3-gram decoding constraint, the main observed behavioral change was increased answer length, while the measured 3-gram repetition rate did not increase. The magnitude of the difference-in-change was larger for the 3B model than for the 0.5B model. This difference was particularly apparent in disease F1, context-supported rate, cosine similarity, and answer length. These results show domain-specific changes associated with using recursive synthetic-data training in biomedical QA, but do not establish clinical hallucination rates or universal model collapse.
Read the full abstract
Robotics
UMR: Universal Manipulation Representation
General-purpose embodied manipulation hinges on a unified action representation that generalizes across embodiments and scales readily. Yet existing policies rely on embodiment-specific action spaces, making cross-embodiment demonstrations difficult to leverage at scale and limiting transfer to new embodiments and spatial variations. To this end, we introduce Universal Manipulation Representation (UMR), a unified action representation that enables zero-shot skill transfer from human demonstrations to heterogeneous robots. UMR decomposes manipulation into two functionally distinct yet geometrically linked components: embodiment-agnostic World Flow, which describes task-relevant object motion in the world frame, and Ego Trajectory, which represents end-effector motion relative to the current pose. We instantiate UMR as World–Ego Point VLA (WEPVLA), a compact 0.5B-parameter policy that learns in the unified geometric action space through a dual-stream Point Action Adapter and a unified Point Action Expert, with an $SE(3)$ conjugation coupling the two components. To improve data efficiency, we complement UMR with a Data-Efficient Strategy (DES) that diversifies object configurations through stage-aware point-cloud editing while preserving demonstrated contact geometry. In simulation, WEPVLA achieves average success rates of 97.5% on LIBERO and 85.7% on the 10-task RLBench benchmark. In real-world experiments, a single policy trained on human demonstrations augmented by DES transfers zero-shot to diverse deployment conditions. With about 10 minutes of collected human demonstrations per task and no robot demonstrations, it achieves 91.7% average success across six evaluation settings, compared with 60.8% for HumanEgo. Code and additional materials are available at https://umr-wepvla.github.io/.
Read the full abstract
Quantum Physics
A threshold for maximal Schmidt number from spectrum
The Schmidt number quantifies the dimensionality of entanglement in bipartite quantum states. We investigate when the spectrum of a state on $\mathbb{C}^d \otimes \mathbb{C}^d$ alone guarantees that its Schmidt number is not maximal. By deriving spectral bounds for $(d-1)$-block positive operators, we prove that $\mathrm{LS}_p\subseteq \mathrm{ASN}_{d-1}$ for $p\leq \lfloor d^2/2\rfloor$, where $\mathrm{LS}_p$ denotes the set of states whose largest eigenvalue does not exceed the sum of their $p$ smallest eigenvalues, and $\mathrm{ASN}_{d-1}$ denotes the set of states whose Schmidt number remains at most $d-1$ under all global unitaries. This also yields a simple sufficient condition involving only the largest eigenvalue. As an application, we show that states satisfying the reduction criterion under arbitrary global unitaries belong to $\mathrm{ASN}_{d-1}$ in every dimension. This subsumes the earlier result that absolutely positive partial transpose states belong to $\mathrm{ASN}_{d-1}$. The global unitary requirement is nevertheless essential: for every $d\geq3$, we construct states of maximal Schmidt number satisfying the reduction criterion on both subsystems.
Read the full abstract
Data Structures and Algorithms
Scheduling with Mandatory Breaks: NP-Hardness and an Additive-One Approximation
In classical fixed-interval scheduling, each job of a given set must be processed during a prescribed time interval. The goal is to assign each job to exactly one machine such that no two jobs assigned to the same machine overlap in their interiors, and the number of machines used is minimized. Without further constraints this is interval graph coloring and is solvable in polynomial time through greedy approaches. We study a variant in which every used machine must remain idle during a contiguous break of prescribed length $x$ somewhere in the scheduling horizon. We show that this additional constraint makes the problem hard, except when $x\le1$. First, for every fixed $x\ge2$, deciding whether $k$ machines suffice for the assignment of a given set of jobs is NP-complete, even when all coordinates are bounded linearly in the number of jobs, so machine minimization is strongly NP-hard. Second, for $x=1$, we give a polynomial-time algorithm that solves the problem exactly. Finally, we give a deterministic polynomial-time algorithm that, on every feasible instance, outputs a schedule using at most $\OPT+1$ machines, where $\OPT$ is the true minimum. Unless $\mathrm{P}=\mathrm{NP}$, no polynomial-time algorithm guarantees $\OPT$ machines for any fixed $x\ge2$, so the additive guarantee of one is best possible.
Read the full abstract
Machine Learning
DreamingGoose: Staged Distillation from Autoregressive Transformers to Bidirectional Recurrent Diffusion Language Models
Pretrained autoregressive Transformers represent a large sunk investment in compute. Existing conversion methods reuse that investment by changing either the architecture (attention to recurrence) or the objective (next-token prediction to denoising), never both. We convert Qwen3 teachers at 1.7B and 8B into attention-free, bidirectional, gated-delta-rule diffusion students in three stages, so that each capability can be traced to the stage that kept or lost it. Language modeling transfers only partially and in-distribution; in-context retrieval does not transfer. On a multi-query recall probe where the teachers score 0.34-0.58, both converted students score 0.000, and diffusion pretraining alone does not restore retrieval. A retrieval curriculum in the final stage, which gradually lengthens the gap between a key-value table and the queries that address it, restores it only stochastically: on a fixed schedule, one seed in three learns to retrieve. Advancing the gap only while a running accuracy estimate stays above a threshold works for all three of those seeds, holds on real text, and carries unchanged to 8B, where two of three seeds succeed. The third had not learned within its fixed 16k-step budget: retrieval switches on abruptly at a seed-dependent step (6.5k and 11k in the other two), so a fixed budget can cut a late run off. One boundary survives every intervention: every model that learns retrieval scores 0.000 on tokens that never appeared in a retrieval episode, and an arm that resamples the key and value tokens every batch shows this is a coverage limit, not memorization of particular bindings. Separately, we convert a 7B code model into a 3:1 recurrent-attention block-diffusion hybrid over 85k steps and report two negative training results.
Read the full abstract
Differential Geometry
Heintze–Karcher-Type Inequalities for the $p$-Laplacian and Serrin-Type Rigidity
We establish a parameterized Heintze–Karcher-type inequality for positive solutions of nonlinear Dirichlet problems involving the $p$-Laplacian, with $p\geq2$, on bounded Riemannian domains. Under a Ricci curvature lower bound, positive boundary mean curvature, and suitable structural and approximation assumptions, the estimate follows from a regularized Reilly-type identity and a weighted Hessian inequality. We compare the resulting bound with previous estimates and investigate the geometry associated with equality. For $p=2$, an exact deficit identity allows the pointwise condition $f'\leq nk$ to be replaced by a weighted integral condition. As applications, we obtain Heintze–Karcher and Soap Bubble-type rigidity results, with equality forcing the domain to be a metric ball and the solution to be radial.
Read the full abstract
Cryptography and Security
RADNPO: Reference-free Adaptive Negative Preference Optimization for LLM Unlearning
Large language models (LLMs) can memorize sensitive, private, or copyrighted content during pre-training, making machine unlearning necessary for removing targeted knowledge. Recent preference optimization (PO)-based unlearning methods improve stability over gradient ascent (GA)-based methods by introducing alignment-style objectives, which effectively suppress the probability of forget targets. However, target suppression alone does not sufficiently constrain the next-token distribution after unlearning. Existing methods provide limited control over how suppressed probability mass is redistributed and insufficiently adapt forgetting strength to target confidence and distributional concentration. Even after target suppression, probability mass may remain concentrated on a few non-target tokens, potentially producing repetitive or uninformative outputs. To address these limitations, we propose Reference-free ADaptive Negative Preference Optimization (RADNPO), which explicitly guides next-token probability redistribution. Specifically, RADNPO contrasts each forget target with alternative tokens favored by the current next-token distribution and adaptively modulates token-level forgetting strength using target confidence and next-token concentration. Experiments on TOFU and MUSE demonstrate that RADNPO achieves a better trade-off between forgetting quality and model utility than current baselines.
Read the full abstract
Robotics
WAM-OPD: Sharpening World Action Models via On-Policy Distillation
Pretrained world action models (WAMs) provide generalist capabilities across diverse robotic manipulation tasks, yet improving target-task performance to an expert level without degrading pretrained skills remains challenging. We explore on-policy distillation (OPD) for WAMs and introduce WAM-OPD. WAM-OPD inherits the advantage of OPD methods that transfer task-specific teacher knowledge under the student's own induced distribution, rather than directly fitting the student to a narrow task-specific data distribution. However, in closed-loop manipulation, the observation histories change as the student policy evolves, requiring fresh environment rollouts to remain on-policy. Applying OPD to WAMs entails repeated data collection, which is costly even in simulation and often impractical on real robots. To avoid repeated environment rollouts during distillation, we introduce prefix-weighted trajectory replay (PWTR). PWTR uses a fixed trajectory pool composed primarily of initial-student rollouts, supplemented with task-specific teacher rollouts to broaden trajectory coverage. For each trajectory replayed from this pool, PWTR conditions the current policy on successive stored histories to generate fresh denoising paths, along which the task-specific teacher provides supervision. Although these denoising paths are refreshed as the policy evolves, the replayed environment trajectories remain fixed. PWTR therefore reweights per-decision distillation losses using proxy importance weights derived from path scores accumulated over the trajectory prefix preceding each decision to mitigate the resulting shift in the history distribution. Simulated and real-world experiments demonstrate task adaptation without additional environment interaction during distillation. In both settings, WAM-OPD improves target-task performance while retaining near-initial performance on tasks excluded from adaptation.
Read the full abstract
Artificial Intelligence
Evolving Support Priorities in Empathetic Reinforcement Learning
We identify a fundamental mismatch in empathetic reinforcement learning: support priorities evolve with the dialogue state, yet existing methods typically optimize predefined reward specifications that remain fixed across turns. To model these evolving support priorities, we organize empathetic support along cognitive, affective, and proactive empathy, and propose Context-Adaptive Rubric Evolution (CARE). At each turn, CARE generates a context-adaptive rubric by adjusting both the weights of these three empathy dimensions and their fine-grained evaluation criteria. The rubric generator is trained with turn-level rubric supervision and human preference data through supervised fine-tuning followed by preference-based reinforcement learning, and then serves as an adaptive reward interface for online empathetic RL. Integrated with both RLVER and MICA, CARE achieves state-of-the-art performance across SentientBench, EQBench3, and EMPA under three independent LLM judges. Notably, on EMPA, CARE improves EPM-Idx over the strongest baseline by at least 13 points under all three judges, including an increase from 28.11 to 83.54 under Gemini-2.5-Pro. Further analyses show that learned rubric priorities systematically vary across dialogue stages and user emotions, demonstrating that CARE adapts what is rewarded as support needs evolve. Code is available at https://asa13opp.github.io/CARE-project-page.
Read the full abstract
High Energy Physics (Theory)
RG Limit Cycles in BKT Flows $\equiv$ Periodic Real-Time Dynamics in the Current-Current Perturbed $SU(2)_1$ WZW Model
We establish an exact correspondence between renormalization-group (RG) evolution and real-time quantum dynamics in the anisotropic current-current perturbed $SU(2)_1$ Wess-Zumino-Witten (WZW) model. Using its integrable fermionic representation, we construct the exact time-dependent many-body wavefunction by means of the generalized Bethe ansatz and show that periodic boundary conditions lead to quantum Knizhnik-Zamolodchikov equations associated with the XXZ trigonometric $R$-matrix, which corresponds to the quantum affine algebra $\mathcal{U}_q(\widehat{\mathfrak{sl}_2})$ evaluated in its spin-$1/2$ evaluation representation. Consistency of these equations constrains the temporal evolution of the longitudinal and transverse interaction strengths. In the universal regime, these integrability conditions are exactly equivalent to the Berezinskii-Kosterlitz-Thouless RG flow equations upon identifying physical time with the logarithmic RG scale. Consequently, the RG limit cycles of the anisotropic current-current perturbed $SU(2)_1$ WZW model are realized as periodic real-time evolution of its interaction strengths. Our results provide an exact dynamical realization of RG limit cycles and establish a direct connection between cyclic RG flows, quantum integrability, and periodically driven interacting quantum field theories.
Read the full abstract
Computation and Language
SALMONN-duo: Adaptive Dual-System Coordination for Full-Duplex Voice Agents
Full-duplex speech large language models (LLMs) enable low-latency, natural voice interaction. However, real-world agents must also use tools and perform deliberative reasoning-operations whose variable latency and computational cost conflict with the stringent timing requirements of real-time conversation. To reconcile these demands, we propose SALMONN-duo, an adaptive dual-system voice agent inspired by dual-process theories of cognition. SALMONN-duo separates real-time interaction from deliberative computation by pairing an always-on, fast-thinking full-duplex speech LLM (system 1) with a powerful asynchronous slow-thinking LLM agent (system 2). Beyond handling real-time interaction, system 1 learns when to answer directly and when to delegate, remaining responsive during backend execution and seamlessly integrating returned information into the ongoing dialogue without exposing tool traces or losing conversational context. Evaluations on single-turn spoken question answering (QA) and multi-turn conversations demonstrate that adaptive delegation substantially improves accuracy on knowledge-intensive and multi-hop reasoning questions, while knowledge-boundary-aware training avoids unnecessary system 2 invocations. On a customized version of $\tau$-Voice, SALMONN-duo further demonstrates its ability to complete environment-grounded, policy-constrained tasks through multi-turn interactions in realistic business scenarios. Finally, cost-aware reinforcement learning further enhances the trade-off between task performance and backend usage across the QA and conversation tasks, while improving task success and response safety on $\tau$-Voice with an acceptable increase in the delegation rate.
Read the full abstract
Machine Learning
CasEm: A Cascade Architecture for Long-Horizon Neural Emulation
Autoregressive neural emulators can drift or diverge over long rollouts despite accurate short-term predictions. We introduce Cascaded Emulation (CasEm), a one-way rollout architecture that augments an existing full-state backbone with an independently evolving model of physically specified aggregates. Its forecasts guide corrections to full-state predictions, without feedback from the backbone to the aggregate model. Effective guidance requires aggregates that cover substantial backbone error, remain accurately predictable, and support useful full-state corrections. We derive a finite-horizon error bound that clarifies these three factors and use empirical diagnostics to guide subsystem selection. Across four ODE/PDE benchmarks, CasEm reduces long-horizon rollout errors across diverse backbones and suppresses the trend toward error divergence in both diffusion tasks using Fourier neural operator backbones. In global climate emulation, CasEm with a regional total-water subsystem reduces 10-year full-state time-mean error by 66.6% and 46.3% for frozen ACE and Spherical DYffusion backbones, respectively, while adding less than 3% to inference time.
Read the full abstract
Cryptography and Security
Certified Multi-Source Integrity for Structured Agent Actions
LLM agents increasingly take privileged, often irreversible structured actions, such as paying an invoice. They assemble each action from action-critical fields in documents and tool outputs that an adversary can corrupt, and indirect prompt injection can drive the model itself to extract attacker-chosen values. Current defenses gate on a source's trust label or certify free-text answer quality. None certifies the integrity of a coupled, policy-bound structured action under a corruption budget that accounts for shared upstream sources. We characterize when such an action is safely certifiable and give the maximally live safe certifier. It admits an action only when each field clears the rule its evidence structure supports: a bounded corruption radius over corruption-distinct evidence classes, counted by a minimum hitting set so that re-publishing or laundered copies cannot manufacture a quorum, deterministic reconciliation for complementary fields, and a trusted anchor where the evidence leaves a field single-sourced. We formalize two robustness notions, validate each mechanism by ablation, and measure how often the multi-source precondition holds on sanctions designations (70,966 entities) and software supply-chain provenance (450 packages). Under upper-bound proxies, genuine corroboration is a minority phenomenon in both, and naive attestation counting overstates it, since witnesses that look independent collapse to two corruption-distinct domains once shared origin is counted. Across five current models in a real agent loop, a realistic injection fools every model but one and a naive agent then executes the fraudulent action on most attacks. The certifier admits no unsafe action and recovers the correct value where corroboration permits, while action-gating and provenance baselines are broken in every world of our harness by some attack in its space.
Read the full abstract
Distributed Computing
Heddle: Learning Structural Templates for Parallelism Planning on Heterogeneous GPU Clusters
Training large machine learning models on shared GPU infrastructures faces two challenges: (1) GPU availability shifts dynamically with varying resource demands from tenants, and (2) hardware heterogeneity accumulates as datacenters continuously adopt new GPU generations. Due to the vast search space induced by heterogeneous GPU types and node sizes, training planners must prune it aggressively to remain tractable, yet must also derive high-throughput plans promptly as cluster configurations change. Heddle achieves this goal through a learning-based planner that reduces the full planning problem to a search over pipeline structures. Heddle encapsulates planning decisions in a structural template and learns to construct plans from templates over diverse cluster configurations offline. This design is effective because structural decisions constitute the performancecritical core of a parallelism plan, while the rest follows by rule or from a small priced candidate set once the plan structure is fixed. Evaluation shows that Heddle matches or exceeds the best plan found by five existing planners across clusters with varying GPU types and node sizes for three models of different sizes by up to 84.5% in throughput on dense models and 4.6x on MoE models.
Read the full abstract
Human-Computer Interaction
When Models Choose the Question: Pedagogical Constraints in Bottom-Up Multi-Agent Inquiry
What shapes a model-generated inquiry when no discussion question is supplied? We introduce a bottom-up forum framework inspired by Philosophy for Children, in which language-model agents read a philosophical narrative, propose and select questions, and develop a shared conclusion without a privileged model facilitator or aggregator. Across 576 forums, contrasting Aristotelian value personas interacted with a blank-slate participant receiving no value-specific instruction. The blank slate remained neutral and was selected more often for conclusions than questions. Yet inquiry narrowed in both form and source: varied initial questions increasingly became either/or alternatives, while discussion concentrated on directions already explicit in the text. Our ECO framework traces this source focus by distinguishing explicit philosophical framing, characters' modeled inquiry, and open-ended narrative material. Across analyzed chapters, participants drew most often on explicit framing. We describe this as a pedagogical constraint: freedom to formulate questions did not necessarily produce freedom from source framing.
Read the full abstract
Artificial Intelligence
Stashbird: Episode-Grounded Lifecycle Reconciliation for Conversational Agent Memory
AI agents require memory that remains consistent as conversational evidence changes. We present Stashbird, an episode-grounded memory system that uses provenance to reconcile derived graph and retrieval state during updates and deletion. Repeated evidence extends support, corrections supersede prior active relations, and deletion removes unsupported state while preserving relations with remaining support. Under fixed semantic decisions, reconciliation produces correct final states in all 20 update sequences, compared with eight without reconciliation, and satisfies the defined checks across 263 deletion interventions. Across four long-term memory benchmarks, Stashbird achieves competitive question-answering accuracy and strong model efficiency. On LoCoMo, it uses 76.4x fewer ingestion prompt tokens than Graphiti and 8.1x fewer retrieval prompt tokens than reproduced Hindsight
Read the full abstract
Artificial Intelligence
AdaGuard: An Adaptive Guard Model with User-defined Policies
Guard models support the safe deployment of language model agents, but fixed risk taxonomies limit their ability to accommodate requirements that vary across applications and tasks. Under user-defined policies, detecting violations requires interpreting both the applicable rules and the agent's behavior, since identical actions can receive different judgments under different policies. To support learning this capability, we introduce AdaptiveSafety, a dataset of 10,939 training examples and 1,000 test examples covering policies with 1–100 rules. The dataset combines trajectories from multiple sources with policy and behavioral counterfactuals, pairing each example with an explanation and the complete set of violated rules. These counterfactuals expose changes that alter compliance, while structural augmentations provide supervision for consistency under rule reordering and identifier remapping. Building on this supervision, we propose SafePO, a reinforcement learning algorithm for refining violation identification while balancing explanatory reasoning and final verdicts. SafePO uses structured rewards to assess prediction correctness, retains group-relative advantages at the response level, and employs a separately trained value model to modulate token weights within explanation and verdict regions. Separate normalization controls their relative contribution to training despite differences in length. Through supervised initialization followed by SafePO, we develop AdaGuard, a family of 0.6B, 4B, and 8B guard models that assess agent trajectories under policies supplied at inference time. Our 4B model achieves binary accuracies of 89.30% on AdaptiveSafety and 71.82% on DynaBench. The project repository is available at https://github.com/Yunhao-Feng/AdaGuard
Read the full abstract
Computation and Language
Coherence-Aware Distributional Evaluation of Open-Ended Text Generation
Existing open-ended generation metrics measure likelihood, lexical diversity, or distributional similarity in generic representation space, yet can miss fundamental dimensions of quality. A prominent blind spot is global coherence: a generated passage may be locally fluent while remaining globally contradictory, causally inconsistent, or topically disconnected. We identify representation as a central bottleneck in detecting these failures and introduce CHORD (Coherence-aware Hidden-state Open-generation Reference Distance), a coherence-sensitive distributional metric. CHORD encodes generated and human-written corpora in the hidden-state space of a frozen LLM using a coherence-eliciting prompt, and compares the resulting distributions using RBF-MMD. To test coherence sensitivity and selectivity, we construct a counterfactual evaluation suite pairing graded coherence-degrading perturbations with meaning-preserving controls. CHORD selectively detects relation, discourse, structural, and mixture failures that perplexity, entropy, MAUVE, FBD, and MMD-based baselines either miss or cannot separate from benign rewriting. Factorial ablations show that representation is the primary source of coherence sensitivity, while RBF-MMD improves sample efficiency. Larger backbones capture finer-grained distinctions, but coherence prompting improves selectivity only when the backbone can follow the prompt. On unconditional generation and prefix continuation, CHORD yields model rankings that strongly align with human judgments of whether outputs make sense and appear human-written. Together, these results establish representation design as central to reliable distributional evaluation. Code: https://github.com/MAPS-research/CHORD. Experiments: https://github.com/MAPS-research/CHORD-Experiment.
Read the full abstract
Cosmology and Nongalactic Astrophysics
Reconstructing the evolution of deceleration parameter with the Lagrange interpolation method
In this paper, we reconstruct the evolution of the deceleration parameter using cubic and quartic Lagrange interpolation methods, based on the latest observational data. This data includes baryon acoustic oscillation (BAO) measurements from DESI, cosmic microwave background (CMB) distance priors from Planck 2018, and three datasets of type Ia supernovae (SNe Ia): DES-Dovekie, Pantheon+, and Union3. To mitigate the impact of the nonuniform distribution of data in redshift, we carry out the reconstruction not only in the standard redshift $z$ but also in the $y$-redshift $y\equiv z/(1+z)$ and the log-redshift $\zeta\equiv\ln(1+z)$. The cubic and quartic reconstructions of $q(z)$ from the DESI BAO+CMB+SNe Ia datasets indicate a clear deviation from the $\Lambda$CDM model at low redshift ($z<0.3$), supporting a weaker present-day cosmic acceleration than the predictions of the $\Lambda$CDM model. The reconstructed $q(z)$ exhibits an overall oscillatory pattern around the $\Lambda$CDM model throughout its evolution. Only the cubic-$y$ and cubic-$\zeta$ reconstructions with the DESI BAO+CMB+Union3 data provide evidence that the cosmic acceleration appears to have already reached its maximum value and is beginning to slow down. However, when incorporating the measurement of the Hubble constant $H_0$ from the Supernovae and $H_0$ for the Equation of State (SH0ES) Collaboration, the evolution of $q(z)$ from cubic reconstructions shifts toward the $\Lambda$CDM prediction. Regardless of the presence or absence of the $H_0$ prior, all reconstructions imply that the deceleration-acceleration transition occurred earlier than predicted by the $\Lambda$CDM model. Nevertheless, the Bayesian evidence still favors $\Lambda$CDM, while the frequentist analysis indicates a $>2\sigma$ preference for the Lagrange-interpolation reconstructions, hinting at the existence of dynamical dark energy.
Read the full abstract
Analysis of PDEs
Boundary Regularity for Fully Nonlinear Singular Elliptic Equations
We study boundary regularity for the fully nonlinear singular elliptic equation of the form $|Du|^\gamma F(D^2u)=f$, where $-1<\gamma<0$. First, we prove pointwise boundary $C^{1,\alpha}$ estimates with pointwise $C^{1,\alpha}$ Dirichlet data, which weakens the $C^2$ domain smoothness requirement from Birindelli and Demengel~\cite{BD10}. The proof uses compactness and perturbation, without flattening the boundary. Second, we extend the $W^{2,\delta}$ estimates of Li and Li~\cite{LiLi17} from balls to $C^{1,\alpha}$ domains with $C^{1,\alpha}$ Dirichlet data{, for $0<\delta\le\delta_0<1$. Here $\delta_0$ is an exponent in the interior $W^{2,\delta_0}$ estimate}. The proof combines pointwise boundary $C^{1,\alpha}$ estimates, interior $W^{2,\delta_0}$ estimates, and a Whitney decomposition.
Read the full abstract
Computer Vision
DecFlowEdit: Self-Localized Flow-based Image Editing via Guidance Decoupling
Flow-based image editing (FlowEdit) enables inversion-free semantic changes through the difference between source and target velocities. In this paper, we observe that FlowEdit's default classifier-free guidance (CFG) configuration, with asymmetric source and target scales, causes substantial background leakage. Matching these guidance scales, for example by removing CFG, improves edit-relevant localization but severely degrades editability. To get the best of both worlds, we propose DecFlowEdit, which decouples the optimal guidance scales for localization and for editing in flow-based generative models. In particular, DecFlowEdit first extracts an edit-relevant prior by temporally aggregating velocity differences evaluated without CFG, and then uses this prior to reweight the original updates under default CFG. Our method remains training-free and inversion-free, requiring neither external spatial masks nor attention manipulation. Experiments on PIE-Bench across FLUX, SD3, and SD3.5 show that DecFlowEdit improves background preservation, reducing structure distance by approximately 61 to 73 percent and background LPIPS by 68 to 80 percent relative to FlowEdit at comparable editing fidelity.