Information Theory · Cross-listed from stat.ME
Locally calibrated and mesh-free inference for spatial point distributions: closed-form null, contamination law, and detectability threshold
Henock Mwanza Lubukayi and Mechack Kabanga Ntolo
Local inference for spatial point distributions is dominated by Monte Carlo calibration. We develop an alternative based on the Tweedie–Miyasawa identities of empirical Bayes, which relate locally weighted moments of a point distribution under a Gaussian kernel to derivatives of its log-intensity in scale space. We first establish a
rigidity theorem showing that the structure of these identities forces the Gaussian kernel. Under complete spatial randomness, we derive a closed-form null distribution for a bounded inter-scale contrast, yielding a calibrated simulation-free pointwise test. In experiments, the measured type I error is 0.070 at a nominal level of 0.05, with a calibration cost 199 times smaller than Monte Carlo for the same local statistic. We then derive a contamination law for structures of dimension m and width w embedded in a uniform background, together with an explicit detectability threshold. For a filament in three dimensions, the threshold is 16 pi. The resulting scale-resolved local dimension
estimator has no free parameters. Applications to California seismicity, a trefoil
knot, and 10,071 SDSS
galaxies show that the method separates local structures across scales without a spatial mesh and reproduces published
cosmic web fractions. All experiments are reproducible from a single public script.
Read the full abstract ▾
Software Engineering
AI Policies: Help or Hindrance? A Software Developer's Perspective
Samuel Ferino, Rashina Hoda, John Grundy et al. (+2 more)
AI policies introduced by software organisations to mitigate LLM-related risks such as sensitive information leaks and unauthorised usage are not useful if software developers do not engage with them. We draw on 19 software developer interviews to show how AI policies help and hinder developers. We suggest approaches to support managers and decision makers with a developer-centric approach to introducing AI policies.
Read the full abstract ▾
All authors Samuel Ferino, Rashina Hoda, John Grundy, Christoph Treude, Hashini Gunatilake
Artificial Intelligence
From Manual Construction to AI-Driven Scenario Emergence: Rethinking Catastrophe Risk Modeling
Hang Gao
Traditional catastrophe (CAT) risk models rely on costly manual construction to generate extreme weather scenarios, an approach largely unchanged since the 1990s. As
climate extremes intensify, this creates mounting challenges to the entire risk transfer chain. This study proposes the TAISE framework, which repurposes AI weather
forecasting models to produce coherent extreme weather sequences at a fraction of traditional costs. Through self-iterative generation, the framework produces continuous global atmospheric fields from which extreme events emerge. A proof-of-concept experiment demonstrates an order-of-magnitude reduction in computational cost compared with conventional methods, while capturing temporal continuity and cross-regional correlations absent in snapshot-based approaches. These findings suggest a pathway toward democratising catastrophe risk quantification and enabling dynamic, comprehensive portfolio assessment for insurers, reinsurers, ILS fund managers and public-sector risk managers.
Read the full abstract ▾
Distributed Computing
PipeSwift: Revisiting Pipeline Parallelism for Large-Scale Completion-Oriented Agentic LLM Serving
Shiju Wang, Fei Ren, Fangcheng Fu et al. (+4 more)
LLM
agents execute long-horizon workflows where each model response determines the progress of subsequent tool interactions and environment transitions. Unlike chatbot serving, where TTFT and TPOT SLO constraints are critical, agentic workloads are completion-oriented and increasingly governed by job completion time (JCT). This shift challenges existing LLM serving designs optimized around
token SLOs. Through a systematic exploration of scheduling and parallelism, we uncover a previously overlooked principle for
agent serving: JCT is governed by the balance between prefill and decode efficiency. A prefill-prioritized scheduling policy achieves the best TTFT and the highest decode throughput, yet fails to attain the lowest JCT. This principle further reshapes the parallelism landscape: we show that pipeline parallelism (PP), long overlooked because it offers little decode-latency advantage, can reduce JCT by providing a more favorable balance between prefill and decode efficiency. Based on these insights, we build PipeSwift, an optimized open-source pipeline-parallel runtime integrated with a tailored micro-batch partitioning strategy co-designed with schedule considering the above trade-off, and pipeline-integrated multi-
token prediction. Evaluated on real coding and web-search
agent trajectories with two 360B+ MoE models on 64 H800 GPUs, PipeSwift reduces overall JCT by up to 1.45$\times$ over SGLang wide-EP, 2.33$\times$ over vLLM PP2, and 1.54$\times$ over today's state-of-the-art open-source PD-disaggregated deployment. PipeSwift is open-sourced at https://github.com/wsjdsg/PipeSwift.
Read the full abstract ▾
All authors Shiju Wang, Fei Ren, Fangcheng Fu, Zhanhong Tan, Kairui Li, Jingwei Cai, Kaisheng Ma
Machine Learning
Decoder Design Matters for ECG Delineation
Joseph Scharpf, William Han, Chaojing Duan et al. (+3 more)
Electrocardiogram (ECG) delineation identifies the boundaries of P waves, QRS complexes, and T waves, providing structural annotations that can guide AI models in learning to interpret ECGs. However, training accurate delineation models requires manual annotations that are scarce and time-consuming to obtain. Recent work addresses this limitation through semi-supervised learning (SSL), but the design of the architecture, particularly the decoder, has received less
attention. To this end, we propose R-U-Net, an ECG delineation model that pairs a ResNet-18 encoder with a U-Net decoder. On SemiSegECG, R-U-Net outperforms the strongest evaluated ResNet-18 + fully convolutional network (FCN) head baseline in each of the 16 in-domain settings by 3.3-13.0 mIoU and achieves 82.6 mIoU in the cross-domain setting, an improvement of 8.1 mIoU. Controlled ablations show that decoder design contributes more to performance gains than the evaluated SSL methods, motivating further exploration of architectures for ECG delineation. All code is open-source at github.com/ELM-Research/ECG-Delineation.
Read the full abstract ▾
All authors Joseph Scharpf, William Han, Chaojing Duan, Michael A. Rosenberg, Emerson Liu, Ding Zhao
Artificial Intelligence
Skill-based Agentic Evaluation for Real-time Data Science Tasks
Aniruddha Tamhane, Raghavendra Addanki, Ayushi Aggarwal et al. (+4 more)
We present a framework for evaluating data-science
agents on live, continuously updated data using executable ground truth and format-agnostic factoid scoring. Consider this example query: "what were last week's audience sizes"—the reference answer changes as the underlying data changes, so static references become outdated and standard LLM-as-a-judge pipelines cannot verify responses against a fixed ground truth. Our central contribution, ground-truth-as-code, encodes each expected answer as an executable reference function that recomputes the answer directly from live data at evaluation time, ensuring the reference remains consistent with the system it describes. We combine this with a factoid-level, format-agnostic judge that decomposes both the
agent's response and the computed ground truth into atomic claims and scores precision, recall, and accuracy over them, irrespective of the response format (prose, list, table, HTML, etc.). The approach is applicable to
agents whose expected outputs can be expressed as executable data computations. We validate the framework through a human–LLM agreement study on an internally developed machine learning skill deployed in production, using a synthetic database constructed to reproduce production schemas and entity relationships. Relative to a natural-
language ground-truth baseline, our method achieves a 29% improvement in the Matthews Correlation Coefficient (MCC)—a class-balanced measure of agreement between expert annotators and LLM-as-a-judge predictions—and a 16% reduction in
token consumption per test case, while a self-directed baseline lacking explicit ground truth is anti-correlated with human judgment.
Agents that perform multi-source data integration and computation over non-stationary data are routinely deployed in industry; we propose ground-truth-as-code as a practical methodology for their evaluation.
Read the full abstract ▾
All authors Aniruddha Tamhane, Raghavendra Addanki, Ayushi Aggarwal, Aditya Bansal, Rui Wang, Charles Menguy, Swati Jain
Computer Vision
VPRef: A Cross-Domain Benchmark for Referring Remote Sensing Image Segmentation
Quanwei Liu, Tao Huang, Jiaqi Yang et al. (+1 more)
Rapid advancements in
vision-
language models have propelled Referring Remote Sensing Image
Segmentation (RRSIS) to the forefront of Earth observation. However, practical deployments suffer severe performance degradation under a coupled dual-drift paradigm: visual domain drift from cross-spatial-resolution mismatches and spectral variations, alongside textual logic drift from unconstrained, variable user-input granularities. To mitigate these bottlenecks, this paper establishes the first cross-domain RRSIS
benchmark, designated as the Vaihingen-Potsdam Referring (VPRef)
dataset, comprising 46,972
language-image-annotation triplets organized into a three-tier linguistic hierarchy. Building upon this
benchmark, we develop a tailored parameter-efficient domain adaptation baseline anchored on the Segment Anything Model (SAM3) via Low-Rank Adaptation (LoRA). Our framework counteracts visual distribution discrepancies through pseudo-label-driven self-training and addresses textual logic drift via random multi-granularity text
prompt mixing. Crucially, the distribution of empirical metrics across ablative variants suggests a potential decoupling between cross-modal semantic robustification and visual domain
alignment, demonstrating that linguistic variance drives fine-grained semantic invariance while pseudo-label propagation governs macro-scale spatial grid
alignment. Extensive
benchmarks demonstrate the proposed framework achieves superior cross-domain
segmentation boundaries while modifying merely 1.08% of the foundational parameter footprint, establishing a robust baseline for future multi-modal remote sensing domain adaptation research. The
dataset and code will be available at https://github.com/quanweiliu/VPRef.
Read the full abstract ▾
All authors Quanwei Liu, Tao Huang, Jiaqi Yang, Wei Xiang
Machine Learning · Cross-listed from stat.ML
Certified Inference and Training for Deep Equilibrium Networks: A Continuation Framework with Polynomial Complexity Guarantees
Alex Borisevich
We develop a certified continuation framework for inference and training in deep
equilibrium networks (DEQs), with training posed as interpolation to accuracy $2^{-b}$. For inference, input homotopy selects an
equilibrium branch from a supplied start root, and a rounded tracker follows it under quantitative conditioning, derivative, boundary, and tube-radius certificates. The framework includes structured factorized certificates, sequential block elimination, inheritance of contraction guarantees in adapted coordinates, and bordered continuation through simple folds. For smooth multidimensional DEQs, including tanh networks, rational local tests can construct and validate oriented continuation charts under explicit
geometric promises. For training, programmable dormant bilinear rank-one channels provide output-preserving residual-aligned repairs. Loaded Tikhonov solves diagnose insufficient parameter-to-output directions, while certified gate realization, column stability, well-posed inference, and finite-update error budgets control each pass. Under polynomially bounded certificate, encoding, precision, and backend costs, both inference and training have bit complexity $O(\mathrm{poly}(L+b))$, where $L$ is the encoded instance length; training uses $O(b+\ell)$ passes and reserve channels from an initial residual bounded by $2^\ell$. A budgeted implementation returns either certified success or inconclusive termination. The quantitative core and local certificate machinery are machine-checked in Lean 4, while numerical experiments illustrate the training mechanism.
Read the full abstract ▾
Human-Computer Interaction
"ChatGPT, what am I missing?": Designing AI Workflows around Professional Task Structure to Shape Analytic AI Use
Zilin Ma, Suzi Jazmati, Marco Chimenton et al. (+4 more)
General-purpose AI lets users choose what support to request, but leaves them to structure the support a professional task requires. We examine how interactive workflows can embed professional task structure without prescribing how users engage with AI. We designed two scaffolded interfaces around the same negotiation scaffold: one presented a completed AI analysis, while the other supported user-directed, incremental development. A four-condition randomized experiment with 800 participants compared these interfaces with no-AI and an AI chat interface. AI-supported conditions improved preparation coverage over unaided work; the scaffolded workflows further improved coverage over chat. Although the scaffolded workflows produced similar coverage, the user-directed workflow elicited a broader repertoire of analytic requests and lower subjective effort. Professional scaffolding therefore depends not only on displayed structure but on how workflows organize users' engagement with it. Effective professional AI must structure how users and AI build analysis together.
Read the full abstract ▾
All authors Zilin Ma, Suzi Jazmati, Marco Chimenton, Yiyang Mei, Jacqueline Lane, Krzysztof Z. Gajos, Finale Doshi-Velez
Numerical Analysis
A Matrix-free Augmented High Order Compact Solver for Variable-Coefficient Biharmonic Problems
Jin Li, Kejia Pan, Xu Qian et al. (+1 more)
We propose an augmented high-order compact finite difference method for biharmonic equations with clamped boundary conditions and variable coefficients. Standard mixed-type formulations introduce an auxiliary variable, but its boundary values are unavailable, leaving the resulting discrete systems globally coupled and difficult to solve at large scales. Our key contribution is the development of a new augmented formulation that treats these unavailable boundary values as additional unknowns, reduces the global coupling to a lower-dimensional Schur complement system, and yields decoupled second-order subproblems. The Schur complement is solved by
matrix-free GMRES, while the subproblems are handled by FFT-based fast solvers. The method achieves fourth-order accuracy using compact stencils, and has $O(n\log n)$ computational complexity, enabling the solution of the biharmonic equation with $1024^3$ degrees of freedom within several minutes. To the best of our knowledge, this level of computational efficiency has not previously been achieved in either the literature or practice. Using energy estimates and
Fourier analysis, we derive a new $L^2$-estimate for Poisson equations with inexact Dirichlet boundary and then prove the convergence of the proposed scheme. We provide ample numerical experiments to confirm the accuracy, efficiency, and further apply the fast and accurate solver to triharmonic equations, high-wavenumber problems, Stokes flow, and plate bending problems.
Read the full abstract ▾
All authors Jin Li, Kejia Pan, Xu Qian, Li-Lian Wang
Computer Vision
MDN-Control: Mask-Depth-Noise Guided Region Control for Multi-Subject Video Editing
Jiayi Yu, Xi Ye, Lina Wang et al. (+1 more)
Multi subject
video editing modifies designated subjects while preserving non target content, but faces cross subject attribute leakage, and occlusion ambiguity. Existing approaches rely on masks and struggle to distinguish overlapping subjects or ensure consistent generation. To address these limitations, we propose MDN-Control, a training free framework jointly controlling target localization, occlusion geometry, and appearance initialization. Specifically, mask-guided localization provides consistent target localization, while depth-aware occlusion control resolves ambiguous boundaries between overlapping subjects. We further introduce noise latent prompting, which retrieves Gaussian initializations from a noise library for
prompt relevant priors. Experiments on MSVBench show that MDN-Control achieves the lowest CM-Err and the highest Q-Edit, while maintaining competitive text
alignment and temporal consistency, demonstrating the effectiveness of combining spatial,
geometric, and latent priors for multi subject
video editing.
Read the full abstract ▾
All authors Jiayi Yu, Xi Ye, Lina Wang, Yunkun Xia
Machine Learning
Online Gradient Computation for Warping Gaussian Process Transformations
Emilio Ruiz-Moreno, Konstantinos Slavakis and Baltasar Beferull-Lozano
Warped Gaussian processes (GPs) handle non-Gaussian observations by mapping them into a latent standard GP via a parametric transformation called warping. Existing streaming variants, however, either optimize the warping parameters periodically or sacrifice analytical tractability for a higher model capacity. To bridge this gap, we show that the gradient of the instantaneous negative log-likelihood of a warped GP admits an exact recursive computation. Based on this result, we propose a novel online method for warped GPs that jointly updates the latent GP moments and optimizes the warping parameters.
Read the full abstract ▾
Social and Information Networks · Cross-listed from physics.soc-ph
Unified framework for measuring segregation resolves how social and geographical space jointly shape connections
Johannes Happenhofer, Sahil Loomba, Till Hoffmann et al. (+2 more)
Our understanding of how geographical and social segregation interact remains limited, as relatively few studies investigate them jointly, and existing approaches often lack a framework distinguishing geographical, social, and total segregation. Additionally, large-scale individually resolved geo-social network data are rarely publicly available. We address both. Conceptually, we develop a unified framework that measures segregation in geosocial networks by comparing network models to appropriate null models and recovers the Theil index, dissimilarity index, and network modularity as special cases. Empirically, we turn to
privacy-preserving aggregated relational data (ARD): we combine the Facebook Social Connectedness Index for the US with US Census and Pew data, and introduce an ARD-compatible joint geosocial intervening-opportunities model to infer link probabilities between region–group
cell pairs. Applying our segregation framework, we find that social segregation predominates over geographical segregation, with notable separation for White–Black, college-degree–no-degree, and high-income–low/middle-income across both segregation types. We find increasing social homophily with geographical distance and group-specific geographical connectivity patterns, suggesting that geographical segregation may affect cross-group connectivity not only directly but also by amplifying social segregation.
Read the full abstract ▾
All authors Johannes Happenhofer, Sahil Loomba, Till Hoffmann, Sumeet Agarwal, Nick S. Jones
Graphics
HairCS: Reconstructing Strand-Based Hair from Hair Cards
Zixuan Lu, Tongtong Wang, Yuefan Shen et al. (+4 more)
We present an automated pipeline that converts hair-card models into high-quality strand-based hairstyles. Given a collection of textured triangular or quad strips as input, our method produces a strand-based representation that preserves the original hairstyle while enriching it with fine-scale
geometric detail and adhering to standard production requirements: strands originate from the scalp, roots are uniformly distributed, and the hair volume is plausibly filled. The resulting assets are directly compatible with strand-based rendering, physics-based simulation, and common grooming modifiers (e.g., clumping, curling, noise) for enhanced realism and artistic control. We validate our approach on a large and diverse set of hairstyles, including short and long hair, curly styles, and complex styles such as buns and ponytails.
Read the full abstract ▾
All authors Zixuan Lu, Tongtong Wang, Yuefan Shen, Zhongtian Zheng, Chenfanfu Jiang, Yin Yang, Kui Wu
Computer Vision
A multimodal large language model for evidence-based autism spectrum disorder screening
Jun Chen, Qi Zhao, Yunliang Jiang et al. (+10 more)
The clinical management of autism spectrum disorder (ASD) faces a bottleneck in early screening, mainly because trained specialists are scarce and conventional assessment tools are subjective. Here, we introduce ASDchat, a
multimodal large
language model designed for evidence-based ASD screening, which takes
video, audio, and dialogue as input. ASDchat adopts a dual-branch architecture, where the decision branch generates screening probabilities and the evidence branch generates traceable, timestamped behavioral evidence aligned with the Autism Diagnostic Observation Schedule (ADOS-2). The model was trained and evaluated on a
dataset of 1,035 participants from 27 sites in China, which covered typically developing (TD) children, children with ASD, and children with other developmental disorders. For ASD versus TD, ASDchat reached an area under the receiver operating characteristic curve (AUC) of 0.953 $\pm$ 0.021. On 6 held-out sites that were not used for training, the mean AUC was 0.961. Furthermore, unsupervised clustering of the behavioral dimensions split the ASD cases into six subtypes with different phenotypic profiles, and ASDchat suggests an intervention for each subtype. ASDchat provides a feasible path for large-scale, evidence-based ASD screening in clinical practice.
Read the full abstract ▾
All authors Jun Chen, Qi Zhao, Yunliang Jiang, Shuqin Cao, Yunqiang Lin, Chenglong Jia, Qiang Guo, Guang Dai, Xiongtao Zhang, Mengmeng Wang, Xiaoyue Ma, Hui Wang, Wenguan Wang
Cryptography and Security
Not All Relations Are Equal: Relation-Balanced and Calibrated Graph Learning for Provenance-Based Intrusion Detection
Lijie Zheng, Ji He, Zhiwei Zhang et al. (+3 more)
Provenance-Based Intrusion Detection Systems (PIDSs) detect Advanced Persistent Threats (APTs) by analyzing system interactions. However, existing methods largely treat relations uniformly, overlooking statistical heterogeneity; in CADETS, relation frequencies differ by approximately $140{,}000\times$. This may cause PIDSs to focus more on frequent relations and overlook differences in normal error levels across relations, increasing the risk of false alarms and missed detections. We present RECAL, an unsupervised framework using relation-balanced masked graph learning to better capture rare interaction patterns. It further calibrates reconstruction errors against each relation's benign error distribution to produce comparable anomaly evidence, helping distinguish attacks from benign behavior and reduce false alarms. On three DARPA E3
datasets, RECAL achieves F1 scores of 99.99%, 99.93%, and 99.99%, outperforming the best baseline on each
dataset by 0.88, 0.82, and 0.42 percentage points, respectively. Compared with the baseline reporting the lowest FPR, RECAL reduces mean FPR by approximately $105\times$, $4\times$, and $41\times$.
Read the full abstract ▾
All authors Lijie Zheng, Ji He, Zhiwei Zhang, Alessandro Brighente, Yulong Shen, Mauro Conti
Software Engineering
Protocol-Preserving Context Trimming for Agentic Workflows: Benefits, Failure Regimes, and Budget Guardrails
Harish Gaggar
Agentic large
language model (LLM) systems rely on long interaction histories to preserve instructions, tool states, intermediate decisions, and unresolved dependencies, but unrestricted context growth increases computational cost and can reduce efficiency. This study evaluates protocol-preserving context trimming as a reliability-constrained approach for multi-step agentic workflows. Five trimming strategies - recency-based, relevance-based, summarization, protocol-aware trimming, and adaptive budget guardrails - were compared across retained-context levels and workflow-complexity classes using task success, protocol adherence, valid tool calls,
token savings, latency reduction, cascading failures, and critical context thresholds. Conventional strategies achieved about 60% mean
token savings but lower task success (66.6-77.3%) and protocol adherence (85.5-88.6%). Protocol-aware trimming improved task success to 92.2%, while adaptive guardrails achieved 96.0% task success, 96.3% protocol adherence, and 1.0% cascading failure with 56.0% mean
token savings. Retained-context budgets of 25% or less increased failure odds 10.92-fold relative to budgets of 50% or more (p < 0.001). Protocol-aware trimming produced 5.24-fold greater odds of successful completion than conventional methods under aggressive budgets, while adaptive guardrails further increased success odds 2.11-fold versus fixed protocol-aware trimming (p < 0.001). Critical context thresholds also increased with workflow complexity. These findings indicate that reliable context reduction depends more on preserving protocol-critical state than on maximizing
token removal, and that adaptive guardrails can improve efficiency, scalability, and reliability in long-horizon agentic systems.
Read the full abstract ▾
Machine Learning
OPD-Aha: From Linguistic Momentum to Visual Reflection in Multimodal On-Policy Distillation
Chenhao Qiu, Dawei Li, Yechao Zhang et al. (+2 more)
Privileged on-policy
distillation improves
multimodal reasoning by allowing a teacher to evaluate student trajectories using rich, training-only visual evidence. Both models score these trajectories while conditioning on the same student-generated prefix. When a student misinterprets an image early in a response, this accumulating erroneous rationale eventually pulls the teacher away from its visual evidence. The teacher and student converge on the same
hallucination, causing standard cross-model supervision to collapse precisely where correction is most needed. We find that the teacher's visual corrective preference is not lost under this misleading agreement. Comparing the predictions of the identical teacher given the real image and a visual null reveals that the privileged evidence still pushes the model toward the correct interpretation. We introduce OPD-Aha, which reconstructs the
distillation target directly from this isolated visual preference rather than relying on the fragile teacher-student discrepancy. This reconstructed target aggressively suppresses continuations that contradict the image. Trained with this objective, students learn to naturally interrupt their own flawed
reasoning with reflection
tokens such as wait and actually. After reflection, subsequent generation relies less on the accumulated erroneous text and more on the visual evidence. Correcting these trajectories mid-generation fundamentally alters the
reasoning process, yielding broad and consistent improvements across diverse fine-grained perception and complex
multimodal reasoning benchmarks. Our code and models are available at https://github.com/Echochef/OPD-Aha.
Read the full abstract ▾
All authors Chenhao Qiu, Dawei Li, Yechao Zhang, Lei Gong, Zhen Tan
Computation and Language · Cross-listed from eess.AS
Language Orthogonalization for Zero-Shot Cross-Lingual Audio Deepfake Detection
Minu Kim, Ji Sub Um and Hoirin Kim
Audio deepfake detectors need to transfer to
languages absent from training, as
multilingual speech synthesis outpaces labeled anti-spoofing resources. While detectors increasingly rely on self-supervised
speech models (S3Ms), these backbones encode
language-dependent structure that confounds spoof cues. We address this confound through
language orthogonalization, a target-free ridge map that removes S3M variation projected onto continuous
language-identification (LID)
embeddings. Across six
languages, six S3M backbones, and all Leave-N-Out settings, it consistently reduces EER across unseen
languages. Cross-lingual EER correlates with LID-space distance, where orthogonalization yields larger gains for more distant transfers.
Read the full abstract ▾
Artificial Intelligence
Fine-Tuning Fixes Mode Collapse and Over-Dispersion in LLMs
Kirill Skobelev, Eric Fithian and X.Y. Han
Recent work by Doshi and Hauser (2024), Bisbee et al. (2024), and Xie et al. (2026) raises concerns that outputs from large
language models (LLMs) tend to be under-diverse: they repeat or resemble one another more often than responses from the population they are meant to represent, a phenomenon known as mode collapse. In this work, we show that whether mode-collapse, or its opposite, occurs depends on the specific model and
dataset used. Further, with sufficient supervised fine-tuning (SFT) data, LLM output diversity converges toward that of the target distribution from which fine-tuning data are sampled. To quantify this comparison, we measure the probability that two responses sampled independently from the same fixed
prompt coincide (collide), or their expected similarity under a kernel. We derive a bias-variance decomposition of the expected gap between the model's and target's collision probabilities, showing that SFT is not inherently biased toward mode collapse or its opposite: finite-sample SFT can leave a model either under- or over-dispersed, depending on the model and
dataset. Finally, we show that the absolute gap is bounded by the square root of the Kullback-Leibler (KL) divergence from the target distribution to the model. Consequently, a model sufficiently close to optimal under population cross-
entropy cannot exhibit arbitrarily miscalibrated diversity. We test the decomposition and the bound in three experiments: small
transformers on synthetic
languages, four LLMs fine-tuned on human surveys, and these LLMs fine-tuned on CodeNet, a
dataset of human code solutions. More target data moves model diversity toward the human (or synthetic target) level in all experiments, consistent with our theoretical predictions. These results show that diversity miscalibration can arise from finite-sample error and shrink as SFT better approximates the target distribution.
Read the full abstract ▾
Information Retrieval
Predicting Partial Answer Quality and Utility in Agentic Retrieval-Augmented Generation
Fangzheng Tian, Debasis Ganguly and Craig Macdonald
Agentic
Retrieval-Augmented Generation (RAG) has become a promising paradigm for multi-hop question answering, where a
reasoning model iteratively issues queries to a retriever and incorporates newly retrieved context into subsequent
reasoning steps. While this iterative process can improve final answer quality, current evaluations of agentic RAG largely focus on end-to-end outcomes and provide limited visibility into how a model's answer state changes during generation. In this work, we introduce an in-trajectory probing framework to study intermediate answer states in agentic RAG. Specifically, after each
retrieval-
reasoning iteration, we force an agentic model to stop
reasoning and generate an intermediate answer based on its current state. This allows us to define two iteration-level measures: partial answer quality at each iteration, and partial utility as the change in partial answer quality across iterations. Our analysis across multi-hop QA
benchmarks reveals that partial answer quality often plateaus before natural termination, with many later iterations contributing only small measurable improvements. Accordingly, we formulate two prediction tasks, partial answer quality prediction and partial utility prediction, and study trajectory-derived signals from intra-iteration, inter-iteration, and query-iteration perspectives. Experiments show that partial answer quality is more predictable than partial utility, with supervised models achieving Pearson's r above 0.43 for quality prediction. Finally, using predicted answer quality and utility for early stopping reduces average iteration count by about 11% while preserving about 98% of the final answer quality achieved by natural stopping.
Read the full abstract ▾
Information Retrieval
PCap: Personalized Retrieval-Stage Diversity Capping in Facebook Marketplace
Guangchao Yuan, Janis Fuh, Christopher Choate et al. (+8 more)
We propose a personalized capping framework (PCap) to improve the diversity in Facebook Marketplace by introducing user-level diversity constraints at the
retrieval stage. PCap models individual diversity preferences using Shannon
entropy-based scoring, segments users into diversity buckets, and applies personalized category caps during multi-source candidate
retrieval. To navigate the high-dimensional parameter space of per-bucket caps, we leverage an automated online optimization method called Parameter Tuning Sequence. Large-scale online experiments demonstrate that PCap significantly improves users' browsing experience shown in engagement metrics. This work provides practical insights into integrating personalized diversity into industrial
retrieval systems.
Read the full abstract ▾
All authors Guangchao Yuan, Janis Fuh, Christopher Choate, Xun Tang, Wenqi Zhu, Chengyi Zhang, Pavan Kumar Paalya Chandrashekar, Jiang Han, Jiangyuan Li, Hongyan Wang, Shuting Wang
Computation and Language
Early-Bird Decoding: Accelerating Diffusion LLMs with Learnable Block Sizes and Parallel Sampling
Lixuan Wei, Wei Zhou, Jianwen Wu et al. (+3 more)
Diffusion large
language models (dLLMs) offer a promising parallel decoding paradigm as an alternative to autoregressive generation through iterative unmasking. However, dLLMs typically require many steps before
token confidence reaches the decoding threshold, resulting in inefficient inference even with block-wise KV caching. To accelerate dLLM inference, we for the first time propose an "early-bird (EB)" decoding framework, motivated by the observation that
tokens with similarly low
entropy tend to cluster and can be jointly decoded earlier, before reaching the confidence threshold. In particular, our EB-Decode framework integrates two key enablers: (1) a learnable network that adaptively groups
tokens with similar uncertainty into variable-length blocks, rather than relying on fixed block sizes; (2) a position-aware sampler that learns to unmask
tokens in parallel using fewer decoding steps within predicted variable-length blocks. Both components are developed without modifying pretrained dLLM weights and can therefore be directly deployed as plug-ins during serving, with negligible training and inference overhead. Extensive experiments across three models and four
benchmarks consistently validate our observation and the effectiveness of EB-Decode, achieving 3.53-18.76$\times$ higher throughput than the vanilla decoding method and up to 1.58$\times$ higher throughput over the strongest baseline, Fast-dLLM, with comparable accuracy.
Read the full abstract ▾
All authors Lixuan Wei, Wei Zhou, Jianwen Wu, Yipeng Shen, Meiling Wang, Haoran You
Numerical Analysis · Cross-listed from math.OC
Beyond Phase Reduction: Amplitude Collapse in Optimal Control of Coupled Oscillators
Faranak Rajabi, Frédéric Gibou and Jeff Moehlis
We solve the four-dimensional Hamilton-Jacobi-Bellman (HJB) equation for two diffusively coupled Stuart-Landau-like oscillators to obtain full-state optimal feedback control. A sweep over coupling strength reveals a sharp change in the numerically optimal strategy: below a threshold coupling value, the controller steers the phase difference toward anti-phase while keeping both oscillators near the limit cycle, as reduced-order models would suggest. Above this threshold, the HJB solution changes qualitatively; the controller transiently collapses one oscillator's amplitude to near zero, thereby enabling large phase repositioning near the origin before rebuilding its amplitude. Direct gradient-based and
stochastic optimization do not recover this lower-cost collapse trajectory from the initializations considered, suggesting that it occupies a region of the control landscape that is difficult to access by direct search. A joint sweep over nonisochronicity and coupling shows that collapse can occur even for an isochronous oscillator: phase repositioning near the origin can favor an off-cycle strategy. Nonisochronicity provides an additional energetic benefit through a phase-velocity surplus at small amplitude, quantitatively accounting for the observed reduction in control cost. Comparisons with uncoupled and coupled phase-reduced baselines show that phase models become increasingly inaccurate and cost significantly more energy for strong coupling. Results for coupled Van der Pol oscillators further demonstrate that exploitation of off-cycle dynamics is not specific to the Stuart-Landau-like oscillators.
Read the full abstract ▾
Computer Vision
Decentralized Gossip Learning and Federated Averaging for Histopathology Image Classification
Yusuf Ozturk, Bengisu Atli, Enes Goktekin et al. (+2 more)
Breast histopathology analysis increasingly relies on distributed learning because direct data pooling across institutions is often restricted by
privacy, governance, and communication constraints. This study compares server-based
Federated Averaging (FedAvg), fully decentralized gossip learning, and Hybrid Gossip-FedAvg for invasive ductal carcinoma (IDC) patch classification. Experiments used 277,524 color image patches with patient-disjoint training, validation, and test partitions and a workload-balanced, Dirichlet-guided allocation across six nodes. Ring, random degree-3, and fully connected gossip
topologies were evaluated together with sensitivity analyses for statistical heterogeneity, mixing coefficient, learning rate, model drift, prediction disagreement, calibration, clinically motivated operating points, communication payload, and patient-level IDC burden, together with auxiliary backbone robustness analyses. In the principal alpha=0.3 experiment, Hybrid Gossip-FedAvg achieved a test area under the receiver operating characteristic curve (ROC-AUC) of 0.8811, closely followed by FedAvg at 0.8801 and fully connected gossip at 0.8751. Across three independent patient-level repetitions, FedAvg and Hybrid Gossip-FedAvg obtained the same mean ROC-AUC of 0.9082, with standard deviations of 0.0037 and 0.0043, respectively. Hybrid achieved the highest mean area under the precision-recall curve of 0.8240, whereas FedAvg produced the lowest mean Brier score of 0.1335. Denser gossip graphs improved discrimination but increased theoretical model payload, while ring gossip remained sensitive to learning rate and mixing strength. Overall, FedAvg provided the most consistently reliable server-based baseline,
topology-aware gossip offered a viable decentralized alternative, and Hybrid Gossip-FedAvg provided a balanced compromise between peer-to-peer
diffusion and periodic global coordination.
Read the full abstract ▾
All authors Yusuf Ozturk, Bengisu Atli, Enes Goktekin, Akin Ozturk, Ulas Bagci
Machine Learning
Adaptive Bayesian Partner Selection for Federated Clinical Centers
Navid Seidi, Satyaki Roy and Sajal K. Das
Federated learning (FL) in healthcare faces pronounced heterogeneity and temporal concept drift across clinical centers, where evolving patient populations and care practices shift data distributions. Existing approaches rely on persistent global communication, incurring substantial bandwidth overhead while risking negative transfer from poorly aligned peers. We propose Adaptive
Bayesian Partner Selection (ABPS), a peer-to-peer framework that governs who collaborates, when, and at what cost. Each center maintains a Beta-Bernoulli posterior over prospective peers' Shapley marginal utility, ranks candidates with an Upper Confidence Bound (UCB) criterion, and forms collaborations through a lightweight propose-reject mechanism, with the option to abstain from communication when no mutually beneficial partner exists. The framework admits a
stochastic decision interpretation, yielding finite-sample concentration guarantees and O(kappa log T) regret in partner selection, along with conditions under which intentional isolation is optimal under negative transfer. Lightweight extensions (head personalization, bfloat16 quantized communication, and a tunable active-set size) further improve efficiency, and a goal-aware metadata filter enables institution-specific collaboration strategies. On binary in-hospital mortality prediction over the first 24 hours of an ICU stay, with 230 non-IID clinical centers drawn from MIMIC-IV, the full ABPS-X variant matches the strongest
federated baseline (FedDyn, AUROC 0.758) at 0.09x the communication cost of FedAvg, with reduced variability. A diversity-driven configuration activates intentional isolation for a substantial fraction of centers. These results show that adaptive, utility-aware collaboration reduces communication without sacrificing accuracy when centers are numerous and small, offering a scalable paradigm for healthcare FL.
Read the full abstract ▾