Software Engineering
Towards Automatically Pruning Logging Code with Coding Agents: How Far Are We?
He Yang Yuan, Haonan Zhang, Xin Wang et al. (+4 more)
Logging code supports debugging, monitoring, and software maintenance, but excessive logging can add noise, impose runtime overhead, and obscure diagnostic information. While prior research has extensively studied logging code generation and modification, logging removal remains comparatively underexplored. In this paper, we study developer logging removal practices and explore the use of coding
agents for this task. We extract and manually validate logging removal cases from Python and Java repositories and derive 10 removal patterns and 11 removal reasons that characterize how and why logging code was removed in real-world software changes. We further construct LogRem, a
dataset of 387 real-world cases covering direct logging statement removal, logging infrastructure removal, and logging replacement. We evaluate four coding
agents with multiple model settings and compare their outputs with accepted real-world changes. Although 95.6% to 100.0% of outputs pass validity checks, only 11.1% to 19.6% remove the same logging code as the corresponding real-world change while preserving unrelated code.
Agents differ through missed removals, extra removals, and unrelated code edits, with substantial variation across logging removal categories and trajectories. Execution cost varies widely, but higher cost does not consistently yield closer
alignment. Commit messages and developer discussions provide the largest
alignment gains, while taxonomy guidance consistently reduces runtime. Overall, our study establishes logging removal as a distinct software maintenance task and shows that reliable automation depends on accurately determining removal scope while preserving necessary code. To the best of our knowledge, this is the first study to examine logging code removal from this perspective.
Read the full abstract ▾
All authors He Yang Yuan, Haonan Zhang, Xin Wang, An Ran Chen, Kisub Kim, Zishuo Ding, Zhenhao Li
Machine Learning · Cross-listed from math.OC
GPU-Accelerated Bregman Douglas-Rachford Splitting for Discrete Optimal Transport
Yifan Xu and Shiqian Ma
We present GPU-accelerated Bregman Douglas–Rachford splitting
algorithm (BDRS) for discrete optimal transport problem in three input formats: an explicit cost
matrix, a point cloud with a ground cost between them, and a separable cost on a regular grid. For each input format, we propose hardware-aware designs of mathematically equivalent representations for the BDRS iterations to enhance numerical stability and empirical runtime. We
benchmark the three proposed implementations against eight GPU baseline solvers from the literature on the same device. We demonstrate that our implementations of BDRS achieve state-of-the-art performance on their respective input formats. To the best of our knowledge, this is the first cross-solver study of GPU DOT solvers with a unified measure of optimality.
Read the full abstract ▾
Multiagent Systems
Organising Trajectory Evidence for Language-Model Agent Assurance: Fragments, Methods, and the Residual
Xiaowei Huang
Methods for assessing
language-model
agents include rule checkers over logs, analyses of skill coverage and composition, support checkers, prefix monitors, execution gates, and rare-event
estimators. Each observes a different part of a run and makes a claim of a different strength, and no common account says how these claims combine or what they leave unchecked. We give one, built from a logic, information fragments, and an assurance ledger. Requirements are formulas of a two-tier logic: an outer finite-trace temporal logic over recorded events, and an inner logic of standing over the argument structure that the
agent's recorded context supports at a decision. A rule violation and an action taken on withdrawn support are thus formulas of one
language. The information available to an assessor, to the
agent, and to an execution gate defines fragments of that
language; each checking method decides one fragment and returns a typed claim: exact, on a named test suite, a risk bound, or descriptive. The ledger merges the evidence and classifies every obligation as established, addressed but not established, or unaddressed. On 456 released $\tau^2$-bench telecom trajectories, the
benchmark oracle flags 231 runs; adding a rule checker, a support stand-in, and a prefix-monitor baseline raises the union to 391, 401, and 407, each contributing flags the others miss, and a gate makes one prohibition exact on a gated deployment. The 49 unflagged runs and the unmet or unaddressed obligations form the residual. Discovery makes unknown requirements explicit, and new or stronger checkers then reduce it.
Read the full abstract ▾
Machine Learning
Localized Operator Learning with Adaptive Partition-of-Unity Mixture-of-Expert Networks
Madison Cooley, Ramansh Sharma, Shandian Zhe et al. (+2 more)
Operator learning methods such as DeepONets and FNOs often struggle with PDE families featuring sharp interfaces, heterogeneous coefficients, and localized multiscale structures. We introduce a partition-of-unity (POU) mixture-of-experts framework for localized operator learning, in which geometry-aware gating networks produce smooth spatial partitions which blend the contributions of local expert networks. Our main contribution is HiRefPOU, a residual-style hierarchical POU architecture for DeepONets that organizes localized representations through nested parent-child partitions while preserving global continuity. We also show that the same POU principle can be incorporated into
Fourier Neural Operators to introduce spatial adaptivity without modifying the underlying spectral layers. On heterogeneous Darcy and reaction-
diffusion benchmarks, HiRefPOU achieves substantially lower error than global DeepONet and static POU-MoE baselines, while the broader operator-learning experiments show that the benefits of localization depend on the PDE structure and the chosen neural-operator backbone. The learned partitions are interpretable and align with interfaces and regions of rapid solution variation. These results show that explicit
geometric localization can improve both accuracy and interpretability in neural operator learning.
Read the full abstract ▾
All authors Madison Cooley, Ramansh Sharma, Shandian Zhe, Robert M. Kirby, Varun Shankar
Human-Computer Interaction
VoCa: Designing Speech-Canvas Interaction for Voice-Based Conversational Agents
Yate Ge, Run Yuan, Yueran Qi et al. (+7 more)
People write and sketch while speaking to explain, organize, and develop content together. Inspired by these practices, we investigate how voice
agents can use a canvas alongside
speech in multi-turn conversations with users. We conducted a two-part formative study: an observational study of how pairs coordinated
speech and boardwork, followed by a design workshop that informed a design space for
speech-canvas interaction with voice
agents. Building on these insights, we developed VoCa, a voice
agent that coordinates
speech with visual object creation, annotation, and
attention guidance. A five-day deployment with 18 participants examined usability, experiences of
speech-canvas interaction, patterns of use, and desired improvements. Participants' experiences highlighted opportunities for
speech-canvas interaction in learning, work, and daily life, alongside challenges in coordinating what
agents say and show in ways users can follow and influence. These findings inform how voice
agents can use a canvas alongside
speech in conversation.
Read the full abstract ▾
All authors Yate Ge, Run Yuan, Yueran Qi, Wenjie He, Jiaqi Mo, Yangshuo Chen, Wenbin Zuo, Xiaohua Sun, Weiwei Guo, Qi Wang
Human-Computer Interaction
Neurodiversity-Aware Multimodal Affective Computing for Neurodevelopmental Assessment: From Norm-Referenced Classification to Context-Sensitive Decision Support
Mateusz Pomianek and Anna Łężniak-Seruga
Automated neurodevelopmental assessment increasingly combines computer
vision,
speech, eye tracking, physiology, and machine learning, yet multimodality and discrimination do not establish construct validity, clinical usefulness, or appropriate interpretation of behavioral variation. We propose a testable architecture for neurodiversity-aware
multimodal affective computing in which population-relative deviation is not treated as sufficient evidence of adverse functioning. This conceptual article reports neither a new participant-level study nor a trained predictive system, and no predictive or clinical superiority is claimed. The framework keeps observable signals, modality quality and availability, context, population-relative information, pooled within-person references and, when sufficiently supported, context-conditioned within person references, and predictive uncertainty distinguishable throughout inference. It defines structured decision-support outputs and auditable requirements for target validity, temporal integrity, contextual leakage, missing-modality robustness, calibration, subgroup evaluation, interpretability,
privacy, and human decision boundaries. The contribution is architectural rather than algorithmic: it specifies empirically testable constraints that can be instantiated with different
multimodal learning methods. Autism provides the principal motivating evidence base, without assuming unchanged transfer to other neurodevelopmental conditions.
Read the full abstract ▾
Machine Learning
Learning Discriminative Geometry for Drifting Models
Doudou Zhang, Wenwen Hou, Yilin Chen et al. (+1 more)
Recently proposed Drifting Models shift iterative distribution refinement from inference to training, enabling effective one-step generation. However, their performance on complex image
datasets depends strongly on the representation used to construct the drifting field: pixel-space drifting performs poorly, whereas pretrained feature spaces substantially improve sample quality for reasons that remain unclear. We trace this gap to the discriminative geometry of the representation, which determines sample weighting in kernel density estimation (KDE) and, consequently drift. We introduce persistent representation learning, which continuously learns a more discriminative representation geometry as the generator evolves across batches. We further establish a current-step gradient equivalence between the KDE ratio loss and drift regression loss under matched conditions, connecting density-ratio-based generator optimization to empirical drifting and motivating direct control of the drifting velocity. Across multiple
datasets, our method learns effective discriminative representations directly from pixels and reduces FID by approximately $82-95\%$ over the original pixel-space Drifting Models, without pretrained encoders. Adapting pretrained representations and applying velocity clipping provide further gains.
Read the full abstract ▾
All authors Doudou Zhang, Wenwen Hou, Yilin Chen, Qi Chen
Robotics
Test-Time Training as Residual Memory for Robot Policies
Haoxuan Wang, Gengyu Zhang, Ramana Rao Kompella et al. (+2 more)
Memory is essential for long-horizon robotic manipulation, where successful actions may depend on past events that are no longer recoverable from the current observation. As episodes grow longer, however, retaining the full history becomes increasingly costly, creating a fundamental scalability challenge for
memory-augmented policies. Existing approaches address this challenge by either storing selected past observations in a bounded
memory bank or compressing interaction history into a fixed-size parametric state through Test-Time Training (TTT). Yet these formulations do not explicitly distinguish between historical information that can already be recovered from the policy's current context and information that must persist beyond it. We introduce TTT-RM, which repurposes TTT as Residual
Memory, using fast weights not to generically compress history but to complement a bounded
memory bank by preserving task-relevant historical information that cannot be recovered from the policy's current context. Concretely, TTT-RM learns a history decoder that reconstructs historical representations from the current observation and retrieved
memory. The resulting reconstruction residual captures what this context fails to explain and serves as the learning target for TTT. The TTT slow weights are optimized against this residual target so that online fast-weight updates learn to encode complementary historical information over time. The fast-weight state is then queried to produce a residual
memory representation that conditions action generation. Extensive experiments on
memory-intensive simulation
benchmarks and real-world tasks show that TTT-RM consistently improves across multiple
memory designs, outperforms diverse baselines, and supports sustained execution on a three-minute, eight-stage stowing task.
Read the full abstract ▾
All authors Haoxuan Wang, Gengyu Zhang, Ramana Rao Kompella, Gaowen Liu, Yan Yan
Computer Vision
Decouple, Purify and Unite: Semantic-Structural Prototype Learning for Federated Medical Segmentation
Xingyue Zhao, Wenke Huang, Linghao Zhuang et al. (+11 more)
Federated learning enables medical institutions to train a global model without sharing data, yet feature heterogeneity from diverse scanners or protocols remains challenging. Existing representation-based methods face two limitations: 1) Incomplete Contextual Representation Learning: single-layer or coupled representations overlook multi-level structural cues and entangle regional semantics with boundary details. 2) Layerwise Style and Aggregation Biases: domain-specific style discrepancies across intermediate layers degrade prototypes, while aggregation that overlooks client distribution shifts can further amplify bias. We propose FedBCS+,
federated decoupled contextual
alignment with style-purified aggregation. We employ Frequency-domain Style Recalibration (FSR) in prototype construction to decouple content-style representations and extract style-purified prototypes. Built upon these purified features, Decoupled Contextual Prototype
Alignment (DCPA) explicitly decouples multi-level features into semantic and structural prototypes and aligns regional semantics and fine-grained anatomical structures separately. Style-purified Semantic Prototype Aggregation (S2PA) measures each client's purified prototype divergence from the global consensus and adaptively reweights aggregation toward under-represented clients to reduce consensus bias. On five heterogeneous medical
segmentation benchmarks spanning histopathology, MRI, ultrasound, and colonoscopy, FedBCS+ achieves the highest mean Dice among the compared methods. A convergence analysis further characterizes how aggregation and
alignment affect the optimization bound.
Read the full abstract ▾
All authors Xingyue Zhao, Wenke Huang, Linghao Zhuang, Yanzhou Su, Zhifeng Wang, Haoyu Zhao, Mengfan Li, Junjun He, Tao Tan, Dakai Jin, Le Lu, Mang Ye, Qiang Yang, Ming Feng
Artificial Intelligence
Not Self-Decidable: LLMs Cannot Draw the Boundary of What an Agent Verifier Can Check
Anthony Rhodes
A verifier for an
agent faces rules of two kinds: the ones a fixed check can settle and the ones that require a judge. A team that derives its own checks fixes that split up front. Where the requirements come from outside, as in finance, healthcare and law, the
agent enforces rules it did not write, so the split falls to runtime, recurring for every predicate of every rule on every action at a rate no reviewer can audit. Every escalation scheme assumes a model can make that decision itself, that it is self-decidable. Across six corpora, including the EU AI Act, FINRA guidance and a deployed credit
agent, we collect roughly 22,000 labels from four models built by three labs. They agree almost perfectly where the answer is obvious and collapse on regulatory text; their errors run in opposite directions, so no model can be trusted as the conservative choice; and on the deployed
agent's own rule-set they err together, over-claiming that a fixed check will do, the direction that never gets escalated. We introduce CoVer (corroborate-then-verify), which treats unanimity as a nomination, admitting a predicate only when the check synthesized for it survives intervention, reading fields the
agent cannot write and holding under deterministic rewording. That gate rejects most of what corroboration wrongly admits, at a cost in coverage we report rather than tune away. The obvious alternative, agreement with a reference judge, certifies nothing: it climbs from 30% to 77% across calibration bands while the genuinely decidable share does not move, because a judge drawn from the population under indictment ratifies the blind spot it shares. Self-decidability is not a capability to elicit from a model but a boundary the verifier must construct.
Read the full abstract ▾
Machine Learning
Score-Calibrated Flow for Sampling from Unnormalized Densities with Applications to Generative Online Reinforcement Learning
Zeyang Li, Yunan Wang, Risheek Garrepalli et al. (+2 more)
Diffusion and flow models provide expressive policy classes for online reinforcement learning (RL), enabling
multimodal behaviors and improved performance. However, training these policies remains challenging: the critic specifies the desired policy as an unnormalized Boltzmann density but does not provide direct samples from it. Many existing methods rely on importance sampling to construct training signals, which can suffer from high variance, increasing computational cost and destabilizing training. We propose Score-Calibrated Flow (SCF), a simple and efficient
algorithm for training generative models to sample from unnormalized densities without importance sampling or backpropagation through the sampling trajectory. We learn the desired flow by enforcing self-consistency, bypassing target posterior mean estimation. By jointly exploiting the prescribed target score and the structure of flow matching, we establish these self-consistency requirements as score-calibrated optimality conditions, first for the terminal density and then for the trainable velocity field. We prove that their unique solutions are, respectively, the target density and the ideal flow model that conditional flow matching (CFM) would recover if target samples were available. We formulate the velocity condition as a fixed-point equation and exploit its conditional-expectation structure to construct a stop-gradient objective for enforcing it. The resulting training procedure retains the scalable sample-interpolate-regress structure of CFM despite the absence of target samples, using endpoints generated by the current flow. For online RL, the critic gradient supplies the target score at the generated actions, yielding a direct approach to actor training. Experiments on RL
benchmarks demonstrate that SCF matches or improves upon state-of-the-art generative-policy baselines, while substantially reducing training time.
Read the full abstract ▾
All authors Zeyang Li, Yunan Wang, Risheek Garrepalli, Mohammad Ghavamzadeh, Navid Azizan
Machine Learning
Low-Fidelity FDM Spectral Guidance for Neural Eigenvalue Solvers
Aryan Chaudhary, Manikandan Padmanaban and Jagabondhu Hazra
Operator
eigenvalue problems appear throughout science. Classical methods usually discretize the operator into a
matrix and then solve the resulting
matrix eigenvalue problem. This works well in low dimensions, but fine grids quickly become expensive in both
memory and computation as the dimension grows. Neural network based solvers avoid storing these large grids, but recent state of the art neural methods can require hundreds of thousands of training steps and may struggle to find the desired
eigenvalues. We show that the two approaches can help each other. A coarse finite difference method (FDM) calculation acts as a cheap numerical model of the operator spectrum. We use the approximate
eigenvalues as fixed shifts during the training of the neural solver, as they only need to locate the relevant part of the spectrum. We also introduce Stabilized Inverse Power Method Neural Network (SIPMNN), a more stable training procedure for higher-dimensional problems. Across five test problems at $d=10$, the combined approach is more accurate overall than the tested fully neural alternatives while using eight to ten times fewer iterations.
Read the full abstract ▾
Information Theory · Cross-listed from quant-ph
Stabilizer codes over general phase spaces
Sayan Chakraborty and Victor V. Albert
We develop a theory of stabilizer codes whose stabilizer groups consist of commuting qudit Paulis, oscillator displacements, and/or planar-rotor displacements. We consider codes whose stabilizer groups form generalized
lattices in
quantum phase space, a condition that guarantees a finite logical dimension. We construct oscillator-rotor, rotor-qudit, and oscillator-rotor-
qubit codes that cannot be decomposed into separate subsystems by generalized Clifford transformations. We also introduce an oscillator-
qubit code arising from a partially lifted Golay code, where Construction A is applied to half of the Golay code coordinates. We derive analytical forms of logical operators from the
symplectic dual
lattice, determine Clifford-Gaussian gates from
lattice symmetries, show that the code dimension equals the covolume of the stabilizer
lattice, and organize the syndrome subspaces into a vector bundle. Our technique builds on earlier non-commutative
geometric results by Rieffel, but it can often be interpreted simply as concatenating a given stabilizer code with a Gottesman-Kitaev-Preskill (GKP) code, applying conventional
lattice-theoretic results, and unconcatenating. We formulate distances, optimal decoding, and
quantum weight enumerators, recovering the Pauli, qudit, and GKP versions together with known MacWilliams identities. We construct finite-energy codewords whose encoding is an isometry up to an error exponentially small in the inverse damping parameter.
Read the full abstract ▾
Artificial Intelligence
Penumbra: Sample-Efficient Adversarial Search for Regulatory Obligations
Anthony Rhodes
Agents are entering finance, healthcare and law, sectors where a violation leaves no lexical signature and carries real penalties. Whether an omission is material, or a disclosure sufficient, depends on what the response left out. Probing such an obligation means finding responses one minimal edit from flipping compliance, and every probe costs a generation and two adjudications, so the binding constraint on regulatory red-teaming is sample efficiency, not volume. We introduce Penumbra, an
adversarial search that walks from a verified anchor under an expanding edit budget until a two-evaluator committee changes its verdict, and emits the two adjacent responses that straddle the change. Allocation is adaptive, and the objective is coverage of the defeat surface: distinct (obligation x defeat mode)
cells resolved per candidate. At matched budget, adaptive allocation reaches uniform allocation's full-budget coverage on 59% of the candidates; at equal records it covers 1.43x the defeat modes of naive enumeration, and the gain is confined to the axis it targets. On 60 screened obligations of a financial advisory constitution, Penumbra returns 144 pairs, each a compliant and a violating response that the committee places on opposite sides of the boundary, differing by a handful of words where a model asked for both directly produces texts sharing almost nothing. A second constitution, for clinical triage, reproduces this on 18 obligations: 49 pairs at the same tightness, with the same modes hardest. Pairs like these show where an obligation's own terms stop deciding, which is what an
agent deployed under it must be tested against, and the search finds them at a cost that scales with the boundary, not the text.
Read the full abstract ▾
Artificial Intelligence
RAGStress: A controlled benchmark for evaluating retrieval-augmented generation under knowledge-base degradation
Shiqi Yang, Jiekai Ma and Gaoyuan Du
Retrieval-Augmented Generation (RAG) is typically evaluated under the implicit assumption that the underlying knowledge base (KB) is clean, leaving the behaviour of RAG systems under realistic KB degradation poorly characterised. We introduce RAGStress, a controlled evaluation
benchmark for stress-testing RAG systems under systematic KB corruption. The
benchmark pairs four naturalistic corruption types (factual corruption, numeric typo, relevance poisoning, and contradiction injection) with three severity levels (subtle, moderate, and obvious) over a single-KB, metadata-filtered experimental design built from 57 MMLU subjects and 182,546 documents. Across 52,500 model-question-condition evaluations, RAGStress reveals that clean
retrieval can mask robustness differences, semantic-fidelity corruptions are substantially more harmful than signal-utility perturbations, no-
retrieval accuracy does not predict corrupted-
retrieval robustness, and mixed-KB accuracy should not be treated as worst-case robustness. We document the
benchmark's intended use, supported claims, and limitations, and provide an artifact bundle including generation scripts, corruption
prompts, metadata schema, and evaluation code. RAGStress is intended as a controlled stress test for RAG robustness under KB corruption, not as a general model leaderboard.
Read the full abstract ▾
Computation and Language · Cross-listed from eess.AS
SepRQ : Self-Supervised Speech Mixture Representation Learning via Mask-Free, Multi-Scale Source Separation
Séverin Baroudi, Hervé Bredin and Ricard Marxer
Self-supervised learning (SSL) is standard for
speech representation learning, but mainstream models are designed around single-speaker audio, limiting their usefulness in multi-speakers scenarios. We present SepRQ, an open-source SSL framework that replaces masked prediction with a pseudo-source-separation objective over frozen random-projection codebooks. By adopting a novel mask-free, multiresolution approach, SepRQ achieves state-of-the-art performance in Speaker Diarization and
Speech Separation on the SUPERB
benchmark, surpassing WavLM and other cocktail-party derived SSLs at both Base and Large scales, while requiring only 85.68M inference parameters. SepRQ also demonstrates strong performance across target-speaker tasks requiring enrollment (such as Target-Speaker Automatic
Speech Recognition), and on the challenging multi-domain DIHARD 3 diarization
dataset. Notably, we report strong separation capabilities on three-speaker mixtures (WSJ0-3Mix), where current SSL literature struggles. While cocktail-party SSLs remain scarce and closed-source, limited to C-HuBERT and the enrollment-based SA-WavLM, we open-source SepRQ to the community.
Read the full abstract ▾
Graphics
Neuroll: Real-Time Neural Strand-Based Hair Simulation via Simulator-in-the-Loop Unrolling
Gene Wei-Chin Lin, Jessica Jia-En Lee, Yu Ju Chen et al. (+2 more)
Time integration has been the cornerstone of physics-based animation that enables the simulation of complex interactions between rigid and deformable objects, including the motion of hair. Despite recent advances with optimized time integration that enabled thousands of hair strands to be simulated in real time, achieving the same performance on commodity hardware remains infeasible due to the computational demands of resolving complex dynamics and interactions between thousands of individual strands. With the rise of learning-based techniques, the offload of time integration to neural networks helps to achieve significant performance gains, making these approaches suitable for real-time applications such as gaming and virtual avatars. However, state-of-the-art neural techniques tend to produce less physically plausible motion and oftentimes fail to generalize to out-of-distribution scenarios. Inspired by classical time integrators, we design a neural counterpart that mirrors their input-output formulation – taking previous hair states, material stiffness, and collision geometry as the inputs for the neural time integrator, which is then trained via a self-supervised, simulator-in-the-loop method with randomized unrolling horizons. By formulating training in each strand's local coordinate frame, we obtain a network that generalizes across multiple dimensions, including hairstyle, material property, body motion, and body type. Our method inherits the benefits of a strand-based neural simulator, and hence is density-independent, lightweight,
memory-efficient, and performant. Our neural hair integrator produces stable long-horizon rollouts and can be naturally extended to support quasi-static simulation simply by resetting hair states.
Read the full abstract ▾
All authors Gene Wei-Chin Lin, Jessica Jia-En Lee, Yu Ju Chen, Egor Larionov, Tuur Stuyck
Computation and Language
Understanding Errors in LLM-Based Question Answering over Imperfect Tables
Baowen Zhang, Wei Fan, Ruman Wang et al. (+1 more)
Answering questions over imperfect tables requires handling errors that can affect the answer. We investigate two challenges for large
language models (LLMs): whether error discovery depends on where errors appear in a table, and whether providing their locations is sufficient for accurate question answering (QA). Using human-reviewed instances from RADAR-T, we conduct controlled studies across three LLMs by varying row order and comparing original, error-marked, and repaired tables. First, reordering rows changes error discovery even when the table contents and gold answer remain unchanged. During direct inspection, LLMs are more likely to discover all rows containing relevant errors when these rows appear later in the table or are grouped more closely together. Second, providing verified error locations alone is insufficient for accurate QA: with code execution, accuracy on repaired tables exceeds that on error-marked tables by 39.0-59.1 percentage points across the three LLMs. As a practical application of these findings, we combine error discovery across shuffled table views with explicit guidance for verifying and handling the reported errors in a simple workflow, Geometry-Balanced Discovery and Intervention (GBDI). On RADAR-T, GBDI improves QA accuracy by 3.8-18.5 percentage points over a code-
agent baseline across five LLMs (paired 95% confidence intervals exclude zero for four), at the cost of additional inference. These results highlight the importance of both reliable error discovery and effective error handling in QA over imperfect tables. Code is available at https://github.com/645-t/GBDI-ICLR-2027.
Read the full abstract ▾
All authors Baowen Zhang, Wei Fan, Ruman Wang, Hangting Ye
Artificial Intelligence
When Debate Helps: Proposal Supply and Verification-Aware Readout in Multi-Agent Reasoning
Zihao Zhao, Tunyu Zhang, Haizhou Shi et al. (+3 more)
Multi-
agent debate can improve
reasoning, yet often fails to beat simple majority voting. We argue that successful debate requires two distinct mechanisms: proposal supply must surface a correct answer, and readout must identify that answer when voting misses it. We formalize the first requirement through recoverable headroom, which measures cases where a correct proposal is available but the majority answer is wrong. For the second, we develop Latent Verification Debate (LVD), an accounting model in which candidate proposals receive answer-specific verification evidence before final generation. Controlled fixed-proposal interventions estimate this latent effect in equivalent peer-support units and show that correct evidence changes answer probabilities and generated decisions while proposal supply remains fixed. To improve proposal supply, we construct societies from neural-thicket
agents using labeled and label-free coverage objectives. Across two backbones and matched-budget
reasoning benchmarks, coverage-selected societies increase complementary proposal supply and improve aggregate accuracy in repeated
stochastic evaluations. Round-level controls further show that interaction provides gains beyond applying the same finalizer directly to the initial proposals. These results identify proposal coverage and truth-sensitive evidence use as complementary conditions for debate to outperform voting. Code is available at https://github.com/Wang-ML-Lab/when-debate-helps.
Read the full abstract ▾
All authors Zihao Zhao, Tunyu Zhang, Haizhou Shi, Yusong Zhao, Xinxi Zhang, Hao Wang
Numerical Analysis · Cross-listed from math.OC
On randomized batch-sampling coordinate descent methods for solving linear least-squares problems
Dong-Yue Xie and Xi Yang
This paper refines randomized block coordinate descent by introducing a coordinate-level batch-sampling distribution characterization, yielding a fine-grained randomized batch-sampling coordinate descent framework, which applies to any block coordinate descent method under an arbitrary static
stochastic sampling rule for solving large-scale linear least-squares problems. Based on this framework, we derive new linear convergence rate bounds that are invariant to the column scaling of data
matrices. Theoretical analysis and numerical experiments validate that the new bounds are significantly sharper than existing results and better aligned with the practical convergence rate. Furthermore, we proposed a learning-based sampling strategy by parameterizing the batch-sampling distribution and optimizing its parameters through gradient-based training. Preliminary numerical results on computed
tomography (CT) reconstruction problems demonstrate that the resulting method converges significantly faster than variants using other fixed sampling rules, and outperforms tested adaptive coordinate descent methods and full gradient descent in computational efficiency, confirming that learned sampling distributions can effectively capture problem-specific structure to accelerate convergence within the framework.
Read the full abstract ▾
Computation and Language
Steering Speech-Language Models: Training-Free Task Specialization via Contrastive Activation Addition
Séverin Baroudi, Yanis Labrak, Pierfrancesco Melucci et al. (+5 more)
Activation steering has proven effective for controlling the behavior of Large
Language Models (LLMs) at inference time, but its application to SpeechLLMs remains new, and training-free steering approaches for such models are still largely unexplored. We propose a training-free Contrastive Activation Addition (CAA) protocol that derives steering vectors for common
speech tasks (e.g. transcription) in SpeechLLMs from a small number of labeled utterances. We showcase that adding these vectors in the representation space, at inference time, enforces better the targeted
speech task. We further show that, when combined with prompting, these vectors yield to consistent improvement over prompting alone on most evaluated tasks such as Automatic
Speech Recognition (ASR) or
Emotion Recognition (ER), and transfer to out-of-domain data. We additionally demonstrate the usefulness of script-normalization directions to enforce the target script of a specific
language.
Read the full abstract ▾
All authors Séverin Baroudi, Yanis Labrak, Pierfrancesco Melucci, Sergio Burdisso, Petr Motlicek, Hervé Bredin, Mirco Ravanelli, Ricard Marxer
Robotics
RoboIRS: Inference-Time Internal Representation Steering for Generalist Robot Policies
Jiuzhou Lei, Chang Liu, Dayou Li et al. (+5 more)
Vision-
language-action (VLA) and world-action models (WAMs) often degrade under out-of-distribution task variations despite retaining partial task capability. To recover such capability, we propose RoboIRS, an inference-time internal representation steering method that uses successful and failed rollouts to train linear classifiers, select outcome-relevant intervention locations, and derive task-specific steering directions without updating policy parameters. On 15 simulation tasks with a frozen $\pi 0.5$ policy, RoboIRS improves the average success rate from 44.4% to 66.2%, outperforming alternative inference-time intervention baselines while adding little inference time. We further validate RoboIRS on real-
robot manipulation using the same $\pi 0.5$ policy and demonstrate its applicability to a world-action model Cosmos Policy, where the average success rate improves from 35.4% to 55.4%. These results show that directly steering internal
robot-policy representations can improve the performance of
robot policies at inference time. Project website is available at https://rollingoat.github.io/roboirs/.
Read the full abstract ▾
All authors Jiuzhou Lei, Chang Liu, Dayou Li, Zhiyuan Zhang, Xiao Liang, Yu She, Zhiwen Fan, Minghui Zheng
Computer Vision
COMPASS: Comet Object Measurement Pipeline with Automated Selection and Scoring
Jack Roberts, Canya Lu, Alexis Michelle Lawson et al. (+4 more)
Summary: The single-
cell gel electrophoresis ('comet') assay is a widely used technique for quantifying DNA damage at the individual
cell level. However, image analysis often relies on manual inspection or semi-automated software, which can be labor-intensive, difficult to reproduce, and sensitive to image quality and comet morphology. COMPASS automates comet assay image analysis by combining deep learning-based comet
segmentation with damage measurement and automated comet selection. The pipeline produces standardized DNA damage measurements while offering robust detection, reducing manual effort and improving reproducibility through transparent selection and optional manual review. Availability and implementation: COMPASS is implemented in Python and is freely available at https://github.com/ rsinghlab/COMPASS. Installation instructions, pretrained weights, and example usage are provided in the repository. Contact: jack_roberts2@brown.edu, ritsingh@illinois.edu Supplementary information: Available onlime upon publication.
Read the full abstract ▾
All authors Jack Roberts, Canya Lu, Alexis Michelle Lawson, Kaitlyn Holden, Gerald S. Wilkinson, Anne M. Bronikowski, Ritambhara Singh
Computation and Language
Extracting Persona Subspaces Through Iterative Nullspace Projection For Modulation
Ananya Malik and Mai ElSherief
Large
Language Models (LLMs) can adopt distinct personas to tune their semantics, expertise, and perspective to different users and tasks. Precise control over these traits is critical to ensure safety and reliability in model behavior. Existing methods like activation steering and
prompt-based persona induction reduce a persona to a single dominant direction, missing the finer, nested traits that emerge only once that dominant signal is factored out. We introduce modulation as a setting where the persona context is already embedded in the content being manipulated, requiring control methods to amplify or suppress a trait already present rather than inject it from scratch. PaSS is an inference-time control paradigm that models personas as multi-dimensional subspaces in a model's latent space without supervised contrastive examples. The persona subspaces are extracted via iterative concept erasure and applied to modulate persona-guided generation without retraining. To extract this subspace, we use Iterative Nullspace Projections (INLP) to linearly and iteratively isolate persona-specific directions. We causally evaluate six personas against diverse tasks like MATH-500, TinyAlpaca, GSM8K, and IFEval, showing that discriminative, iterative subspace extraction captures diverse traits underlying a given persona, enabling stronger and larger modulation than single-direction additive methods, while maintaining content fidelity. We further study individual peeled directions within each subspace to uncover the distinct aspects of persona behavior they encode. Overall, we show that persona subspaces offer a controllable, interpretable, and generalizable framework for modulating LLM behavior without sacrificing task performance.
Read the full abstract ▾
Cryptography and Security
Indistinguishability Lifting for Keyed Oracles, Compressed Ideal Cipher, and More Applications
Ritam Bhaumik and Yu-Hsuan Huang
Cryptographic security proofs often involve an adversary interacting with a larger, keyed oracle that consists of (potentially exponentially) many independent instances of a smaller, base oracle. However, showing
quantum indistinguishability between two such keyed oracles can be tricky, since a single query made by an adversary may involve a superposition that covers all instances of the base oracles simultaneously. In this paper, we establish a generic indistinguishability lifting
theorem of the following form: if the two base oracles are indistinguishable under
quantum queries, then their corresponding keyed oracles are too, up to an O(q^2) multiplicative loss in distinguishing advantage, where q is the number of queries made by the adversary. Our lifting
theorem applies to both statistical and computational settings, and to oracles that are stateful as well. It is also optimal in that it matches the obvious Grover search attack for a certain (contrived) choice of oracles. As an immediate application, we extend Carolan's compressed permutation oracle to an efficiently implementable compressed ideal cipher, and use it to prove preimage resistance of the Davies-Meyer compression function in the
quantum ideal cipher model. Thanks to our lifting
theorem, the soundness of our compressed ideal cipher reduces to that of Carolan's oracle, and any further improvement on the latter would automatically carry over to the former. As our second application, we give a modular construction that doubles the message length of any
quantum-secure strong pseudorandom permutation. Along the way, we show that an existing two-round tweakable Feistel construction is indistinguishable from a random permutation under
quantum bidirectional queries. This is done via a dedicated
polynomial-method argument, which may be of independent interest.
Read the full abstract ▾
Artificial Intelligence
MASBench: Benchmarking LLM-based Multi-Agent Collaboration under Partial Observability
Qizhi Chu, Zekai Yu, Sijie Wen et al. (+5 more)
Large
language models (LLMs) have progressively evolved into the core of autonomous
agents. Building on this progress, LLM-based multi-
agent systems (MAS) coordinate multiple
agents into a synergistic team to accomplish complex tasks that exceed the capabilities of individual
agents. The effectiveness of such systems depends not only on the
agents themselves, but also on how collaboration mechanisms are designed and organized. Note that real-world collaboration is typically partially observable, where each
agent can only access partial information about the environment due to physical or
privacy-related constraints. However, many existing multi-
agent benchmarks assume global observability, and leave limited support for systematically evaluating collaboration mechanisms. To bridge this gap, we introduce MASBench, a multi-
agent collaboration
benchmark designed under partially observable constraints. It is organized into three progressive task categories:
Reasoning, Scheduling, and Game. Through this structure, we progressively evaluate three representative collaboration mechanisms: Protocol,
Memory, and Routing. MASBench further provides deterministic evaluation metrics, including performance score, communication cost, and cost effectiveness, to characterize both collaboration outcomes and communication overhead. Experiments across diverse LLM backbones and mechanism configurations offer empirical guidance for effective MAS design. Code is available at: https://github.com/BUPT-GAMMA/MASBench
Read the full abstract ▾
All authors Qizhi Chu, Zekai Yu, Sijie Wen, Yang Liu, Chen Qian, Cheng Yang, Chuan Shi, Zhiyuan Liu
Machine Learning · Cross-listed from math.OC
Asking the Crowd the Right Question: Bias-Cancelling Weights for Federated Learning
Ilya Kuruzov, Dmitrii Vishovan, Kirill Novoselov et al. (+3 more)
A
federated objective is a weighted sum of client risks, and the weights are almost always fixed in advance. We treat them instead as the only instrument of a wisdom-of-crowds mechanism: clients are noisy views of one truth, each seeing it through an independent distortion that is unbiased across the crowd. That the optimal weights are inversely proportional to the clients' error energies is classical; we begin at the question that answer presupposes, which energies belong there and whether a crowd can recover them from itself. Excess risk on the truth is of the exact order of the aggregate bias energy, so no optimizer can repair a bad weight vector; the truth itself is identifiable only up to a linear tilt, so subtracting estimated client biases provably reproduces uniform weighting. The expected per-client second moments, however, are exactly identified from the law of the crowd's disagreement by a well-conditioned linear inversion, a step random-effects meta-analysis cannot take because a source reports once; their realized counterparts are estimable up to an incoherence floor the
algorithm can measure. This yields CROWD, which reads the disagreement off the optimization trajectory at no extra cost and matches a
Bayesian minimax lower bound in the same constant: per instance as the horizon grows, and unconditionally as the prior becomes diffuse. For arbitrary distortions it stays competitive with the optimal weights, at a ratio governed by a
geometric incoherence the
algorithm can measure. On real scans split into sites with their own miscalibrated detectors it attains the oracle excess risk; on a companion federation that pulls bias and noise apart, weighting by noise variance is worse than not weighting at all, and CROWD is not.
Read the full abstract ▾
All authors Ilya Kuruzov, Dmitrii Vishovan, Kirill Novoselov, Yuriy Dorn, Darina Dvinskikh, Alexander Gasnikov
Artificial Intelligence
A Tropical Geometry View of Forgetting: A Per-Unit Projector for Knowledge-Preserving Fine-Tuning
Yuyang Zhang, Xiaoyin Chen, Chunlin Ren et al. (+1 more)
Fine-tuning a
language model on new text degrades what it already does. Replay-free projectors such as Adam-NSCL and GPM forbid one shared subspace of a layer's inputs in every row of the update. The tropical geometry of a ReLU layer shows why this is too coarse. In data space, the units' walls are tropical hypersurfaces whose
cells are dual to the upper vertices of a zonotope; in weight space, each old
token is a hyperplane, and the
tokens cut out a polyhedron, the closure of the weights that keep every
token on its side. An exact identity joins the two pictures: the squared change of the layer's output under any weight change splits into in-
cell, open-to-closed and closed-to-open terms, and the first two live on the
tokens each unit fires on. The identity names a gate-aware per-unit projector, and a budget-separation
theorem prices exact protection: it costs a unit the rank of its own open
tokens, while a shared subspace pays at least the rank of their union in every row. On OPT-1.3b, where 96% of (
token, unit) pairs are closed, the projector forgets less than Adam-NSCL at all six matched budgets from 9 to 60 constrained directions per row, the gap widening from $1.1\times$ to $4.3\times$; with 1/5.5 of the directions it halves the forgetting of Adam-NSCL at GPM's energy threshold. On OPT-6.7b, it matches Adam-NSCL's forgetting at matched budget while learning more. As the theory predicts, the open/closed partition is the operative variable: open
tokens beat random, sign-blind and anti-gate
token sets on 18 of 18 seed-pairs. In
pruning repair, every derivative-based local model of the output error at the dense weights is blind to pairs that open: the minimisers of the gate-weighted objective can leave the polyhedron, the objective's closed-form solution is 1.94 nats worse than no repair on OPT-1.3b, and a convex one-sided penalty bounds the escape.
Read the full abstract ▾
All authors Yuyang Zhang, Xiaoyin Chen, Chunlin Ren, Qihuang Zhang
Social and Information Networks
Exact computation of the network modularity with branch-and-bound
Emily Weng and Georg Hahn
We consider the computation of the network modularity, a common measure of the structure of networks or graphs that quantifies the division of a network into modules or clusters. The computation of the network modularity is an NP-hard problem, thus making its exact computation often infeasible in practice. This has resulted in the development of several heuristics in the literature. In this work, we consider the exact computation of the network modularity with the help of a branch-and-bound
algorithm. Our
algorithm is guaranteed to find the optimal clustering that maximizes the network modularity, however it achieves this without a full exploration of the search space. This is accomplished by bounding partial solutions and discarding them if it can be foreseen that a partial solution will not yield an improvement over an existing solution. We assess our
algorithm with respect to accuracy and runtime and compare it to a brute-force approach as well as two
benchmark algorithms, simulated annealing and the Louvain method.
Read the full abstract ▾
Information Theory · Cross-listed from quant-ph
Quantum-State Oblivious Transfer over Quantum Erasure Channels
Remi A. Chou
We study
quantum-state oblivious transfer over the
quantum erasure channel under information-theoretic security guarantees. Specifically, Alice holds two
quantum systems, Bob wishes to recover one of them, and the parties have access to independent channel uses and authenticated public classical communication, with no initial shared
entanglement. We consider both honest-but-curious and malicious behavior. We establish finite-blocklength converse and achievability bounds, which match in the honest-but-curious setting. The malicious setting construction combines interactive hashing with tests of whether Bob received selected channel outputs, and distributes each input across several
qubits so that erasures conceal an entire input from a dishonest receiver, even when the inputs are entangled with an external reference. We also derive fixed-error asymptotic expansions and show that both malicious and honest-but-curious settings have the same capacity.
Read the full abstract ▾