Peer Revenue Past citations are no guarantee of future returns

Papers

Fresh from arXiv, typeset properly. Highlighted words trade on the market.

Statistics

stat Watch Statistics (sign in to use)

Friday 12 June

Statistical Computation · Cross-listed from econ.EM

Forecasting with Bayesian Panel Vector Autoregressions Using the R Package bpvars

The R package bpvars was designed to forecast employment, unemployment, and labour market participation rates of 189 countries. However, it is generally applicable to dynamic panel data due to the flexibility of its modelling framework and robust coding. It includes a family of Bayesian hierarchical panel Vector Autoregressions (VARs) that are characterised by: (i) country-specific VAR models (ii) with their parameters' priors centred around their global counterparts, and (iii) featuring flexible multi-level hierarchical prior distributions (iv) with many variants of well-established in the literature benchmark choices, and (v) four alternative specifications including groupping of country-specific or global parameters. A~distinguishing feature is its implementation of missing observation treatment based on a model-coherent Bayesian approach. These models are accompanied by Bayesian prediction, offering a wide range of possible specifications that aim to increase forecasting precision and comply with various reporting standards. We also implement pseudo-out-of-sample recursive forecasting for evaluating point and density forecast performance. The package implements model specification, estimation, and forecasting routines, facilitating simple workflows and reproducibility, including estimation and forecasting results summaries and visualisations. It achieves extraordinary computational speed thanks to the employment of frontier econometric and numerical techniques, as well as algorithms written in C++.
Read the full abstract

Statistical Methodology

HSCI: Neyman-Orthogonal Causal Inference under High-Dimensional Proportional Hazards

Valid treatment effect inference in survival studies is fundamental yet challenging when the treatment assignments and outcomes are confounded by many baseline covariates. To this end, in this paper we propose a high-dimensional survival causal inference (HSCI) framework that delivers valid inference under a sparse high-dimensional Cox proportional hazards outcome model and a high-dimensional logistic propensity score working model. To mitigate the nuisance estimation bias, we develop a Neyman near-orthogonal score for the treatment effect and implement it with cross-fitting. Under doubly robust nuisance-rate conditions, we establish the root-n asymptotic normality and consistent variance estimation. We also extend the framework to inference on high-dimensional survival covariate effects. Simulation examples confirm that HSCI reduces sharply the bias relative to the regularized Cox estimators and maintains valid confidence interval coverage across different dimensionality, censoring, and misspecified propensity-model settings. An application to diffuse large-B-cell lymphoma data further showcases its value for high-dimensional biomedical survival studies.
Read the full abstract

All authors Yingying Fan, Lan Gao, Daoji Li, Jinchi Lv

Statistical Methodology

G-computation for causal effect estimation from observational hierarchical data with unmeasured cluster context

Observational studies frequently involve hierarchical data structures in which individuals are nested within higher-level units. In such settings, unmeasured cluster-level factors may confound the treatment-outcome relationship and may additionally induce treatment effect heterogeneity across clusters, complicating causal effect estimation. We formalize the use of g-computation for hierarchical observational data by incorporating random-effects models (REM) as outcome models and propose a within-group g-computation strategy designed to reduce bias arising from unmeasured cluster context. The approach groups clusters according to their observed treatment prevalence and performs g-computation within groups before aggregating group-specific estimates. Through extensive Monte Carlo simulations, we compare the standard and within-group implementations of g-computation using both linear models and REM. Results show that both standard and within-group REM-based implementations substantially reduce bias when the unmeasured cluster-level variable acts solely as a confounder, whereas the proposed within-group REM estimator achieves the lowest RMSE when the unmeasured cluster-level factor acts as both a confounder and a source of treatment effect heterogeneity. We apply the proposed within-group REM estimator to estimate the causal effect of adolescent pregnancy on the child height-for-age Z-score using 2019 Bangladesh MICS data, obtaining an estimated effect of -0.12 (95% bootstrap CI: [-0.18, -0.06]). The proposed within-group g-computation framework offers a strategy for reducing bias from unmeasured cluster-level confounding and treatment effect heterogeneity in hierarchical observational studies.
Read the full abstract

Statistical Methodology

A Two-Stage Statistical Framework for Evaluating Associative Interference in Large Language Models

Large language models (LLMs) are increasingly evaluated for bias using adaptations of human psychological paradigms, yet methodological limitations-particularly the conflation of refusal behavior with task performance-have hindered clear interpretation. Here, we adapt the Implicit Association Test (IAT) to a controlled, forced-choice framework and introduce a two-stage modeling approach that separates response compliance from task-consistent classification. Across three contemporary LLMs (Claude Sonnet-4, Gemini 2.5 Pro, and GPT-5), we evaluate associative interference, defined as reduced task-consistency in incongruent relative to congruent conditions. While compliance with the structured response format was uniformly high, interference effects varied substantially across models and domains. Claude Sonnet-4 exhibited strong interference in the Gender–Career domain (DeltaP = 0.086, 95% CrI [0.026, 0.173]) and smaller but credible effects in Gender–Science. Gemini 2.5 Pro showed attenuated interference, and GPT-5 exhibited minimal or no detectable interference across domains. These findings demonstrate that IAT-style associative asymmetries are not a universal property of LLMs, but instead depend on model-specific characteristics. By isolating interference from compliance and modeling item-level variability, this study provides a principled framework for evaluating structured response patterns in LLMs. The results highlight the importance of model-specific assessment and suggest that associative interference can be substantially mitigated in modern systems.
Read the full abstract

Statistical Methodology · Cross-listed from cs.LG

DTVEM-RE: A Hierarchical Random-Effects Extension of the Differential Time-Varying Effect Model for Person-Specific Multi-Lag Estimation in Intensive Longitudinal Data

The Differential Time-Varying Effect Model (DTVEM) of Jacobson et al. (2019) is a popular tool for finding the best time lag in intensive longitudinal data, but it assumes everyone shares the same lag structure. The original authors named fixing this as future work, and it clashes with the premise of modern clinical research, which is that people differ. We present DTVEM-RE, an extension that lets each person have their own lag coefficients, with two versions of the confirmatory step: a discrete-time hierarchical Bayesian VAR in Stan, which pools across people and gives calibrated uncertainty, and a continuous-time per-person Ornstein-Uhlenbeck model in ctsem, which handles unevenly spaced beeps directly. We report four results. A simulation shows the Bayesian version recovers the between-person spread tau_a with bias below 0.01 and coverage of 90 to 93 percent. On the Fisher et al. (2017) EMA dataset (N=40), person-specific lag-1 effects vary by an order of magnitude across three mood items, the Bayesian and GAMM estimates agree closely (r=0.87 to 0.92), and DTVEM-RE gives the best one-step-ahead prediction among four discrete-time methods. A multi-lag version shows all nine tau_k values have credible intervals excluding zero, and the lag where people differ most changes across items, something lag-1-only methods like mlVAR cannot detect. Finally, the two versions agree almost exactly on person-specific lag-1 estimates (r >= 0.995), differing only as shrinkage predicts. DTVEM-RE is, to our knowledge, the first person-specific implementation of DTVEM-style lag detection, and it contains standard DTVEM as a special case.
Read the full abstract

Machine Learning (Statistics) · Cross-listed from physics.bio-ph

Temperature transferable Machine Learned Coarse Grained model for proteins

Coarse-grained (CG) molecular simulations offer an efficient alternative to atomistic molecular dynamics to study large and complex biological systems. The accuracy of CG simulations has been increased dramatically by the introduction of machine-learned coarse-grained (MLCG) models. However, these models are typically designed to be used at a single thermodynamic point, lack temperature transferability, and can not be used to predict temperature dependent quantities like the heat capacity. Here we introduce a thermodynamically informed, temperature-transferable MLCG framework for proteins that explicitly decomposes the CG potential of mean force (PMF) into its energetic and entropic components. The model architecture enforces an exact thermodynamic relation between the energetic and entropic components of the PMF and guarantees physically consistent extrapolation and interpolation across temperature regimes. We validate this framework on an extensive dataset spanning a total of 250 $\mu$s of molecular dynamics simulations across five temperatures between 300 K and 400 K for the Chignolin protein, and demonstrate that it reproduces the temperature dependency of the reference atomistic free energy surfaces, correcting the temperature-unaware baselines. Furthermore, we show that it is possible to apply an inexpensive, post-hoc temperature-dependent correction that does not require retraining the MLCG potential, accurately recovering the atomistic heat capacity at different temperatures. Overall, this work provides a physically grounded pathway toward thermodynamically transferable MLCG simulations of complex biomolecular systems.
Read the full abstract

Machine Learning (Statistics) · Cross-listed from cs.LG

Lyapunov-Based Sample Complexity Analysis for Weakly-Coupled MDPs

We study the sample complexity of learning in average-reward weakly-coupled Markov decision processes (WCMDPs) and Restless Bandits (RBs) under a generative model. Naive reduction to a tabular MDP leads to high complexity bounds as the state-action space is exponentially large in the number of arms $N$. By exploiting the weakly coupled structure, we show that near-optimal policies can be learned with sample and computational complexities that are polynomial in $N$. Specifically, we analyze the plug-in approach, which applies an efficient planning algorithm to an empirical model estimated from data. For fully heterogeneous WCMDPs, we establish the first finite-sample PAC guarantee with polynomial complexity and an $O(1/\sqrt{N})$ optimality gap. For homogeneous RBs, we further prove that a smaller optimality gap is achievable under mild structural assumptions. A primary technical contribution of our work is a novel Lyapunov-based analysis framework. Unlike classical approaches that rely on the difficult-to-control bias function, our framework uses an explicitly constructed Lyapunov function along with a drift transfer technique between the true and empirical models. A key step of independent interest in our framework is a fine-grained perturbation analysis for the underlying linear programming (LP) relaxation, which provides a general tool for analyzing LP-based policies and weakly-coupled systems.
Read the full abstract

All authors Tianhao Wu, Matthew Zurek, Weina Wang, Qiaomin Xie

Statistical Methodology

Cauchy Aggregation of Ridge-Regularized Hotelling Tests for High-Dimensional Change-Point Detection

Ridge-regularized Hotelling-type (RHT) change-point tests depend on a ridge parameter $\lambda$, but the power-optimal value is determined by the unknown covariance structure and the unknown mean shift. We avoid selecting a single ridge value by computing fixed-ridge p-values on a finite deterministic grid and aggregating them with the Cauchy combination rule. Under the standard random-matrix conditions for fixed-ridge RHT statistics, we establish finite-grid joint weak convergence of the ridge processes. This leads to fixed-level validity under joint-limit calibration and small-tail validity for the analytic Cauchy p-value. Monte Carlo experiments show that deterministic-grid Cauchy aggregation has stable size behavior and achieves power close to the best stable fixed ridge choice across a range of covariance and signal configurations.
Read the full abstract

Statistics Theory

Confidence Bands for the Gradient Lines of a Density Function

We consider the problem of estimating the gradient ascent line of a density originating at a given point. Going beyond mere consistency, we establish a weak convergence result for a plugin estimator based on a kernel density estimator of the density. We then leverage that result to construct a confidence region for the gradient ascent line, including by bootstrap.
Read the full abstract

Statistical Methodology

Bias-corrected empirical likelihood-based inference for the tail index under heavy-tailed models

The tail index parameter of heavy-tailed probability models plays a key role in characterizing the tail decay of the underlying distribution function and is often involved in extrapolation procedures for various extreme value analysis questions. In this paper we revisit the question of tail index estimation and combine the ideas of bias-correction and empirical likelihood estimation to propose an estimator that offers an attractive alternative to some of the existing estimators. We develop an asymptotic theory for the proposed estimator and conduct simulation studies to demonstrate its performance in finite sample situations. The method is also applied to a data example for illustration.
Read the full abstract

Machine Learning (Statistics)

Hybrid Uncertainty Sensitivity Analysis Based on the HSIC for High-Dimensional Responses with Aleatory–Epistemic Separation

Quantifying the influence of hybrid aleatory and epistemic uncertainties on high-dimensional system responses remains a major challenge in global sensitivity analysis (GSA). Existing Hilbert–Schmidt Independence Criterion (HSIC)-based approaches are primarily restricted to single-output settings and lack a rigorous decomposition of heterogeneous uncertainty sources and their interactions. To address this limitation, a novel double-space tensor-product RKHS framework is proposed for sensitivity analysis under hybrid uncertainty. By constructing factorized kernels over both the latent input space and the multidimensional output space, a concurrent double Möbius inversion is derived to orthogonally decompose the global dependence measure into pure aleatory effects, pure epistemic effects, and their interaction contributions. The resulting dimension-wise sensitivity indices preserve the uncertainty attribution structure across all output dimensions. To satisfy the independence assumptions required by the decomposition, an auxiliary-variable representation based on the inverse probability integral transform is introduced, enabling the treatment of hierarchical uncertainties and Copula-induced correlations within a unified latent space. A fully vectorized single-loop implementation is further developed to avoid the computational burden of nested Monte Carlo simulation. Statistical significance and estimation uncertainty are quantified through permutation testing and Bootstrap confidence intervals. Numerical studies on a modified multi-output Ishigami function and an aerodynamic pressure-field problem demonstrate the accuracy, scalability, and practical applicability of the proposed framework.
Read the full abstract

Machine Learning (Statistics)

Anytime-Valid Confirmation of Label-Shift Corrections

In small-batch scientific deployments, labeled target outcomes may be too scarce for reliable shift estimation even when unlabeled target inputs are available. We address the complementary setting where the practitioner has a pre-specified label-shift correction from domain knowledge and asks whether incoming labeled outcomes support it. We show that the per-observation likelihood ratio between a label-shift-corrected predictive and the source predictive is a conditional e-value, so its running product is a nonnegative martingale and Ville's inequality yields an anytime-valid confirmation rule. The log martingale equals the cumulative negative log-predictive density (NLPD) gap between the source and the corrected predictive, converting routine model monitoring into a formal sequential test. Rejection means the incoming data support the posited correction relative to the source predictive, but it is not a precise estimate of the degree of shift. Closed forms are available for GP sources with Gaussian label-shift ratios. GP regression simulations validate Type I control, finite-sample power, miscalibration sensitivity, and the small-batch advantage of a reliable prior over label-based re-estimation.
Read the full abstract

Machine Learning (Statistics)

Geometric Domain Adaptation via Optimal Transport for Linear Regression in R^2

Optimal Transport has become recently a powerful method for domain adaptation by aligning source and target distributions. We study a supervised domain adaptation problem where source and target domains are related by a rotation or a translation or a homothety in $\mathbb{R}^2$. We prove that the optimal transport map recovers the underlying map when using a $p-$norm cost with $p \geq 2$. Based on this insight, we develop a method combining $K-$means and optimal transport to estimate the underlying map, enabling adaptation of linear regression models when target data is scarce. Simulations demonstrate improved performance over baseline methods. Rather than relying on highly expressive deep learning architectures, we focus on classical machine learning models to emphasize interpretability and theoretical insight. This perspective allows us to explicitly characterize the role of optimal transport in recovering geometric transformations such as rotations, translations, and homotheties. Our contributions include a theoretical result linking optimal transport and rotations, translations and homothecies in $\mathbb{R}^2$, and a practical method for adaptation in linear regression offering both conceptual clarity and applied value in domain adaptation tasks in this space.
Read the full abstract

Statistical Methodology

Tail representations for absolute, signed-power, inverse, and logarithmic moments

Let $X$ be a real-valued random variable and let $p>0$. When $X$ can take negative values, $X^p$ is not generally real-valued for non-integer $p$; formulas for moments of arbitrary positive order must therefore distinguish the absolute power $|X|^p$ from the signed power $\operatorname{sgn}(X)|X|^p$. Using the layer-cake identity, we give a self-contained treatment of tail representations for the positive and negative parts of $X$, including absolute and signed-power moments, centered forms, and exact formulas on ordered discrete supports and integer lattices. The basic identities require neither a density nor continuity and apply to continuous, discrete, singular, and mixed distributions. For strictly positive random variables, we also give representations and finiteness criteria for inverse moments, together with distribution-function and Frullani–Laplace formulas for logarithmic moments. Examples illustrate two-sided support, atoms, lattice tails, and behavior near zero. The presentation places these classical identities in a common notation and states the domain and integrability conditions required in each case.
Read the full abstract

Statistical Methodology

Reliable Panel Regression: A Default Workflow for Slow-Moving, Mismeasured Variables

Political scientists often interpret coefficient shrinkage under fixed effects as evidence that pooled associations are confounded. This paper shows why that inference is unreliable for slow-moving, mismeasured regressors. Fixed effects can remove much of the signal and identify coefficients from within-unit variation that is disproportionately measurement error, attenuating estimates toward zero. A lone fixed effects coefficient may therefore be unable to distinguish confounding from measurement error. I show that the attenuation depends on a regressor's empirical intraclass correlation and measurement reliability. I then propose a default workflow for panel regression. Researchers estimate reliability when possible, report pooled and fixed effects estimates with corrected within reliability, use partial identification bounds when the estimates share a sign, and report fixed effects as a within-unit estimate when they do not. For variables with no reliability estimate, I introduce an autocorrelation frontier that bounds the attenuation factor directly. I conclude by applying this workflow to several published results to show that the data often cannot distinguish attenuation from confounding, and the workflow makes clear which case the researcher faces.
Read the full abstract

Machine Learning (Statistics)

A Bregman Perspective on Classification and Regression Trees

Classification and Regression Trees (CART) constitute one of the most influential paradigms in statistical learning. Although a variety of impurity measures have been proposed for different statistical models, these criteria are typically introduced on a case-by-case basis and analyzed separately. In this paper, we study CART through the lens of Bregman divergences. This perspective places the classical least-squares criterion, Poisson deviance, Kullback-Leibler-type losses, and other impurity measures associated with exponential-family models within a common framework. As a result, key ingredients of the CART methodology – including node representatives, impurity measures, and split selection rules – can be expressed and analyzed through general properties of convex functions rather than through separate model-specific constructions. Beyond the algorithmic formulation, we investigate theoretical properties of Bregman-based CART procedures. In particular, we analyze how geometric properties of the generating convex function influence impurity reductions and stability of recursive partitions. We also establish consistency results within the proposed framework, providing a unified theoretical treatment for a broad family of CART type procedures. Our results provide a geometric interpretation of impurity-based tree construction and show that many classical CART impurity criteria admit a common interpretation within a Bregman framework.
Read the full abstract

Machine Learning (Statistics)

Adaptive Nucleus Truncation for Long-Form Reasoning

Sampling plays an important role in long-form language-model reasoning. Over thousands of decoding steps, small changes in the candidate token set can compound into different reasoning trajectories, stability profiles, and final answers. Existing truncation methods such as top-$p$, min-$p$, and fixed top-$n\sigma$ sampling improve over unrestricted sampling, but they rely on fixed thresholds that cannot adapt to changes in entropy, task difficulty, training stage, or generation budget. We introduce Adaptive Nucleus Truncation Sampling (ANTS), which extends top-\(n\sigma\) sampling from a fixed decoding rule into an adaptive rollout-control mechanism for long-form generation. ANTS selects standardized neighborhoods around the maximum logit before temperature scaling, adapts the truncation width using an entropy-conditioned controller, and retains a no-truncation fallback arm to stabilize training when truncation becomes unsafe. On a 33B-total / 4B-active sparse Mixture-of-Experts reasoning model, ANTS improves average performance over percentage-based benchmarks by +1.9, +3.8, and +5.2 points at 8K, 16K, and 32K generation budgets, respectively. The strongest gains appear on instruction following and mathematical reasoning, with IFBench improving by more than 10 points at 32K and AIME 2025 improving by 7 points. Code generation reveals an important budget interaction. On Codeforces, ANTS trails the baseline at 8K, but reverses this gap and substantially improves ELO at 16K and 32K. These results suggest that sampler design should be treated not just as a decoding hyperparameter, but as part of how we stabilize and scale long-budget reasoning.
Read the full abstract

Thursday 11 June

Statistics Applications

Event-Aligned Analysis of Multi-Rater Pain Assessments Using Continuous Wearable Physiology

Pain is assessed differently by patients, nurses, and clinicians, yet most computational approaches assume a single ground-truth label - effectively ignoring who is doing the rating. We introduce a rater-aware, event-aligned framework that converts sparse, rater-specific pain ratings into discrete pain-change events and aligns continuous wearable physiological signals to these events, preserving rater identity throughout. Applied to multimodal wearable data collected during spine-related pain procedures, the framework identifies substantial disagreement across rater groups and provides preliminary, exploratory evidence of rater-dependent physiological differences preceding reported pain increases. These findings suggest that pain-physiology relationships may not be rater-invariant, and that aggregating assessments across raters may mask meaningful physiological patterns. A rater-aware, event-aligned perspective is therefore a promising direction for interpreting wearable data in real-world clinical pain assessment.
Read the full abstract

All authors Saba A. Farahani, Elahe Khatibi, Thomas D. Hughes, Ariana M. Nelson, Hung Cao, Amir M. Rahmani

Machine Learning (Statistics) · Cross-listed from cs.LG

Weibull Weight-Scale Parameter Evolution under AdamW Training Dynamics

Building on a two-parameter Weibull framework for diagnosing transformer weight distributions, we study why the Weibull weight-scale parameter $\lambda$ grows, overshoots, and then relaxes during AdamW training. We derive a leading-order three-force decomposition of the squared weight norm from the AdamW update: an alignment force measuring the correlation between weights and the adaptive update direction, an injection force from adaptive step magnitude, and a decay force from decoupled weight decay. On self-trained Pythia-70M models with ground-truth optimizer moments, alignment dominates the rise phase, contributing 88-94% of the absolute force budget across four random seeds and remaining robust to super-weight removal. Near saturation, alignment and decay approach balance, explaining the transition from weight-scale growth to relaxation. These force dynamics directly govern the squared-norm component underlying $\lambda(t)$; the remaining RMS-to-Weibull reconstruction offset is measurable and decomposes into bridge and integration components, totaling approximately 5-6% in densely sampled regions. To extend the analysis to real models where optimizer moments are unavailable, we introduce a spline displacement method that recovers the alignment force from sparse checkpoints with approximately 92-94% accuracy, about twice the naive two-point baseline. We further observe that the peak value of $\lambda(t)$ varies with training-data coherence in our experiments, suggesting a data-dependent component of weight-scale growth that we leave to a controlled follow-up study. Code and data are available at https://github.com/tiexinding/NPM-Weibull-public.
Read the full abstract

Statistical Methodology

Bridging data-driven priors via the score function for posterior sampling – Comparative review and experimental study

This paper reviews how a diverse set of popular data-driven priors commonly used in Bayesian inverse problems can be unified through their respective score functions. By framing these priors under this common perspective, we show that they can benefit from their straightfoward and effective integration into a recently proposed sampling algorithm. The applicability of this common framework is illustrated by considering several data-driven priors, namely regularization-by-denoising, normalizing flow-based priors, score-based generative models, and convex-ridge regularizers. For these four particular priors, the performance of the method is evaluated when conducting image inpainting and single image super-resolution. These results, as well as those obtained when restoring real images acquired in a geological context, demonstrate the efficiency of the method. This unified framework proves versatile enough to handle any posterior distribution defined by a broad class of score function-based priors, beyond the specific cases considered in this paper.
Read the full abstract

All authors Elhadji Cisse Faye, Mame Diarra Fall, Sylvain Delchini, Nicolas Dobigeon

Statistical Methodology · Cross-listed from q-fin.RM

Two Sides of Schur Damping: High-Dimensional Pseudo-Likelihoods and Portfolio Allocation

Two communities that rarely cite each other – spatial statisticians fitting high-dimensional weather fields, and quantitative investors building portfolios – have independently arrived at the same mathematical object: a Schur complement, damped by one interpretable parameter. In spatial modeling the Schur complement is the conditional covariance that makes a Gaussian (Vecchia) pseudo-likelihood estimable at scale, and recent work regularizes it by shrinking toward a base model. In allocation it is the residual risk of a bet net of its hedge, and the same parameter interpolates hierarchical risk parity and the minimum-variance portfolio. We show these are one operation – reliability shrinkage of a conditional Gaussian – so that the damping a weather model needs to remain estimable when stations outnumber observations is, term for term, the damping a portfolio needs to remain stable when assets outnumber returns. The optimal amount is a closed-form reliability, a James-Stein shrinkage that is simultaneously a Ledoit-Wolf intensity. The shrinkage machinery is classical, but the identity appears to be new: to our knowledge neither literature has noted that the conditional shrinkage a spatial model fits and the diversification-variance tilt a portfolio chooses are one and the same quantity. We make the correspondence precise, note that the two literatures have each supplied what the other lacks, and report a small experiment on the one genuinely open choice – how to set the damping – suggesting the spatial community's fitted intensity is, if anything, the better recipe.
Read the full abstract

Statistical Methodology

Scan Statistics for Nonhomogeneous Poisson Processes with Extreme-Value Calibration and Application to CNV Detection

We develop a scan statistic method for detecting local clusters in a two-sample nonhomogeneous Poisson process (NHPP) framework, motivated by copy number variation (CNV) analysis in next-generation sequencing data. The control sample is used to construct an empirical time transformation, under which the transformed case sample is approximately uniform on [0,1] under the null hypothesis. The scan statistic is defined as the maximum number of transformed points within a moving window. We show that the scan statistic converges to a generalized extreme value (GEV) distribution with an extremal index that captures the dependence induced by overlapping windows. The GEV parameters and extremal index are estimated using maximum likelihood and exceedance clustering methods, providing an asymptotic calibration of the test. A permutation procedure is also developed to provide a nonparametric alternative. Simulation studies show that the permutation calibration maintains empirical Type I error close to the nominal level across the considered settings, and the GEV calibration is accurate for smaller windows. Both proposed procedures show competitive power compared with the continuous testing method under heterogeneous baseline intensities. An application to sequencing data illustrates the effectiveness of the proposed approach for detecting CNV regions.
Read the full abstract

Statistical Methodology

Constraint-based difference graph discovery in a linear setting

Comparing causal relationships across populations is essential in many scientific domains. This paper studies the problem of inferring a difference graph between two environments and proposes a causal discovery method for linear structural causal models based on equality tests of regression coefficients. We show that invariance of regression coefficients is governed by graphical conditions that go beyond standard d-separation. Therefore, we introduce diff-separation, a graphical criterion that characterizes when a conditioning set blocks all paths capable of inducing differences in regression coefficients across environments. Building on this criterion, we introduce a corresponding diff-faithfulness assumption, linking graphical diff-separation statements to equality constraints on regression coefficients. Finally, we propose LDiffPC, a PC-style algorithm that uses equality tests of regression coefficients to recover the differences from multi-environment data.
Read the full abstract

Statistics Applications

How Should We Measure Empirical Risk when Synthesizing Population Data?

Synthetic data has become a prominent solution for preserving privacy while sharing data, but current empirical risk assessment frameworks fundamentally assume a sample-based context that fails to translate for the evaluation of synthetic population level datasets. This commentary explores the implications when synthesizing entire populations in order to do population-level data science, arguing that traditional metrics, such as Membership Inference Attacks (MIA) and Attribute Inference Attacks (AIA), require re-examination. First, MIA may be rendered irrelevant in contexts where population membership is public knowledge or not considered sensitive information. Second, the risk of singling out is heightened because the confidential data contain full population information. Additionally, the absence of an "out-of-sample" comparison group for attribute inference means we need to define other policies when defining acceptable inferences. Finally, we cannot rely on simply returning to subsampling prior to generating synthetic data if the use case is truly to enable population-level data science. This commentary highlights the necessity for considering context when generating and evaluating synthetic population data.
Read the full abstract

Statistics Theory · Cross-listed from econ.EM

The Generalized Fisher Transformation: Finite-Sample Properties and Inference

We study the finite-sample behavior of the Generalized Fisher Transformation (GFT), the parametrization of a correlation matrix $C$ by $\gamma(C)=\operatorname{vecl}\log C$. The GFT coordinates extend Fisher's transformation to dimension $n>2$: for elliptical data their finite-sample distributions are close to Gaussian. More strikingly, the coordinates are nearly uncorrelated and their covariance is largely invariant to $C$. This approximate orthogonality and invariance make GFT-based inference far better behaved in finite samples than inference based on sample correlations or element-wise Fisher transformed correlations, yielding estimation errors that are approximately Gaussian, weakly dependent, and nearly pivotal.
Read the full abstract

Statistical Methodology

Controller-Augmented Hidden Markov Models: A Computational Framework for Constrained Sequential Inference

Hidden Markov models are foundational for sequential inference, but their Markovian assumption fails under pathwise constraints such as precedence requirements, visitation cardinalities, or monotonic state progression, which induce long-range dependencies that invalidate standard dynamic programming algorithms. To deal with this, we present Controller-Augmented Hidden Markov Models (CHMMs), a framework that compiles each constraint into a finite-state controller tracking the minimal sufficient history, after which standard forward–backward and Viterbi recursions on the augmented chain compute exact constrained posteriors and maximum a posteriori paths in both discrete and continuous time, the latter through uniformization. We establish four theoretical guarantees: exactness of constrained inference, monotone ascent of constrained EM, inference complexity linear in the controller cardinality, and a total-variation bound under constraint misspecification. A catalog of controller encodings covering 11 constraint families across the ordering, visitation, path, and temporal categories operationalizes the framework. Empirically, we evaluate CHMMs against 6 alternative decoders on 3 real-world sequence-labeling tasks of substantively different character: gene-structure decoding in Drosophila melanogaster, free-living activity recognition in CASAS smart-home environments, and protocol-defined human activity recognition from wearable sensors. The results reveal a clean local-versus-cumulative dichotomy in which controller augmentation is uniquely able to recover globally feasible trajectories on cumulative-constraint regimes, whilst simpler decoders are matched in validity on locally-dominated regimes. Together, theory and experiment characterize when exact controller augmentation is necessary and when simpler approaches suffice.
Read the full abstract

Machine Learning (Statistics) · Cross-listed from math.NA

Approximating Gaussian Whittle-Matern Fields over Well-Centered Triangulations of Riemannian Manifolds

Markovian Whittle-Matérn fields have been convergently approximated by discrete Gauss Markov Random Fields (GMRFs) with sparse precision matrices using a Finite Element approximation of the two-parameter family, \[ (\kappa^2 - \Delta)^{\alpha/2} u = \mathcal{W}, \;\; \kappa \in \mathbb{R}, \; \alpha \in \mathbb{N}. \] of SPDEs. Using recent developements in the analysis of Discrete Exterior Calculus (DEC), we present a different, yet closely related, convergent GMRF approximation to these Matérn fields over complete, boundaryless Riemannian manifolds discretized as well-centered simplicial complexes. This convergent method (i) is agnostic to $\alpha, \kappa$ and thus allows a universal approximation scheme for the precision and covariance matrices of the entire $(\alpha, \kappa)$-family of GMRFs, so they may be inferred rather than guessed. (ii) inherently models pointwise and piecewise-smoothed measurements of a random field and approximates both equally well (iii) is computationally independent of the interpolants used - it suffers no overhead if one convergent interpolant were replaced with another suitable interpolant over the same mesh. Furthermore, we show that, on discretizations that are well-connected in a precise sense, and volume-concentrated, the precision matrices are spectral functions of a graph-laplacian. We provide a low rank approximator to the family of such Matérn GMRFs and mention a use case: reducing the number of measurements needed to model the GMRF by compressed-sensing.
Read the full abstract

Machine Learning (Statistics) · Cross-listed from cs.LG

A Stationarity-and-Coupling Criterion for Training-Free Time-Lagged Spectral Embeddings of Multivariate Time Series

We study training-free fixed-length descriptors for multivariate time series and ask not merely whether such a descriptor performs well, but when it can be expected to work at all. Our object of study is $D(\tau)$, built from a time-lagged correlation matrix truncated at the Marchenko-Pastur edge so that only signal-bearing eigenvalues survive and classified by cosine similarity to class centroids with zero learned parameters. The central contribution is not the descriptor but a falsifiable applicability criterion for it. Working from a stationary Gaussian VAR(1) model, we argue that $D(\tau)$ separates two classes when the signals are approximately stationary and the class information lives in their cross-channel temporal coupling rather than in marginal per-channel power. We derive, semi-formally, three consequences: a distinguishability condition, why the static ($\tau=0$) covariance collapses to chance, and why a stationary but power-discriminated paradigm defeats the descriptor. The criterion is operational: a two-part pre-flight test – an augmented Dickey-Fuller stationarity check and a power-baseline saturation check – predicts applicability before any training. We validate both halves on a mixed assortment. On four paradigms that satisfy the criterion (Sleep-EDF, BCI-IV-2a, MIT-BIH, ESC-50) the descriptor is competitive with strong baselines at a fraction of their cost, reaching $88.5\pm4.5\%$ under 20-subject leave-one-subject-out on Sleep-EDF on a single CPU thread. On three that violate it – non-stationary ERPs, and financial-volatility and wearable-stress regimes that are power-discriminated – it fails exactly as the pre-flight predicts, and these negatives are the more informative half. We are explicit that $D(\tau)$ is not the most accurate representation; its value is a compact, training-free embedding whose domain of validity is known in advance.
Read the full abstract

Machine Learning (Statistics)

Recursively Trained Diffusion Models: Limiting Collapse Distribution and Spectral Characterization

Recursive training of generative models on their own outputs can lead to model collapse, a compounding drift away from the true data distribution. Existing theoretical works bound finite-round error accumulation in the context of diffusion models, but two questions remain open:~what distribution does the recursion converge to, and how fast? We answer both, isolating a mechanism distinct from imperfect learning: even with perfect score estimation and exact sampling, the early stopping of the reverse diffusion (required for numerical stability) drives a progressive drift away from the data distribution. We prove that this recursion converges geometrically to a unique limiting distribution, which admits a closed-form characterization as an infinite mixture of increasingly Gaussian-smoothed versions of the data distribution. A Hermite spectral decomposition of this limit reveals that recursive training acts as a low-pass filter: higher-order modes, which encode fine non-Gaussian structure, are attenuated much more strongly than coarse modes. This spectral picture motivates annealed truncation schedules that progressively shrink truncation times across retraining rounds; we prove that any schedule converging to $0$ asymptotically eliminates recursive compounding. Finally, we show our idealized characterization is robust: in the presence of discretization and score estimation errors, the learned distribution remains in a Wasserstein-2 ball around the ideal limit, with mode-dependent contraction rates that contract high-order errors faster than low-order ones. We validate the theory on synthetic Gaussian mixtures and CIFAR-10.
Read the full abstract

Machine Learning (Statistics) · Cross-listed from hep-ph

Conformal calibration and look-elsewhere effect in anomaly detection for new-physics searches

Machine-learned anomaly detection is reshaping searches for new physics, but it has outrun the statistics used to interpret it. A raw anomaly score has no calibrated meaning, a model that scans many regions inflates the look-elsewhere effect, and the asymptotic significances the field relies on are blind to the background mismodelling that anomaly detectors are especially prone to. We propose a calibration layer, built on conformal prediction, that turns any anomaly score into a defensible significance with distribution-free, finite-sample guarantees. Conformal prediction converts scores into valid local p-values, weighted and Mondrian variants repair the sideband-to-signal-region exchangeability failures that resonant searches suffer, and a Gross-Vitells step carries the result through to a look-elsewhere-aware global significance. The layer does two things at once. It exposes miscalibration that the standard pipeline cannot see, and it corrects it without retraining the detector. On public LHC Olympics data, a classifier develops a substructure-mass correlation that makes sideband-calibrated background p-values anti-conservative. Taken at face value, this manufactures a $\sim 46\sigma$ excess from background sculpting alone, which the label-free weighted correction removes, restoring an honest null. When run as a blind wide-mass bump hunt, the standard asymptotic and unweighted procedures fabricate $\gtrsim10\sigma$ excesses and $\approx5\sigma$ excesses even in signal-free windows, while the conformal layer raises no false alarms and its global false-positive rate is verified on background-only pseudoexperiments. The result is an auditable, detector-agnostic path from an uncalibrated score to a trials-factor-aware significance, ready to be folded into experimental anomaly searches.
Read the full abstract