Statistical Methodology · Cross-listed from stat.AP
Seasonal false alarms in customer churn and decline early-warning systems: adjacent-window labels confound seasonality with decline, and a year-over-year correction
Md Rezwanul Islam and Wael Mohammed
Customer decline early-warning systems feed account-manager action lists, and every flagged account consumes intervention capacity. In a deployed business-to-business marketplace system, one action-list slot in three went to flags that dissolve under a seasonally aligned label. The standard target in non-contractual churn prediction compares an entity's next k months of activity with its trailing k months. The two windows cover different calendar months, so for seasonal entities the threshold-ratio construction confounds seasonality with decline, and the event rate depends on the label's anchor calendar month. We formalize the mechanism and measure it on three public panels and the production panel (the public arms pre-specified). Of the adjacent-window decay events, 37–69% on the public panels and 28–50% in production have no counterpart under a seasonally aligned definition. Pooling anchors, the standard remedy, balances the training mixture but corrects no individual label. Measured alternatives repair the curve only partially or change the detection horizon. Aligning the baseline to the same k calendar months one year prior – advice practitioners already state, here formalized, measured, and costed – flattens the curve at the source. With the classifier held fixed, production holdout ROC-AUC rises from 0.767 to 0.864 for decline (different targets; the gap closes on synthetic ground truth and a production hindsight referee). The served action list shrinks by a third, 119 to 79 accounts. The measured price is extra history, a blind spot to decline-then-stabilization, and a stricter cut under sustained growth.
Read the full abstract ▾
Statistical Methodology · Cross-listed from cs.LG
Pessimistic Meta-Induction and Its Limits: Lessons from Frequentist Statistics and Machine Learning Theory
Hanti Lin
This paper challenges the pessimistic meta-inductive argument against scientific realism by undermining its inductive step rather than its historical premise. Although related challenges already exist, I develop a new one. Drawing on a general epistemology of scientific inference developed in frequentist statistics, machine learning, and formal epistemology, I evaluate induction in terms of convergence to the truth. I argue that ordinary enumerative induction can achieve everywhere convergence, whereas meta-induction fails even to achieve almost everywhere convergence. Indeed, in the problem context where meta-induction arises, the failure is deeper: no inference method whatsoever achieves almost everywhere convergence.
Read the full abstract ▾
Statistical Methodology
Nonparametric Estimation of Extropy, Rényi Extropy, and Tsallis Extropy: Almost Sure Convergence and Asymptotic Normality
Amadou Diadie Ba
This paper proposes a nonparametric estimation procedure for extropy and its extensions, namely the {\alpha}-Rényi and {\alpha}-Tsallis extropies, for finite discrete random variables. We establish almost sure rates of convergence and asymptotic normality for the plug-in
estimators. The theoretical results are validated through a comprehensive simulation study. The findings provide a solid foundation for the use of extropy-based measures in practical applications, including forecasting, risk assessment, and decision-making under uncertainty.
Read the full abstract ▾
Statistical Methodology
Identifying Model Quality Effects on User Engagement: A Within-Version Causal Estimator with Synthetic Data Validation
John Tribbia
Every team building Large
Language Models (LLMs) faces a core challenge: offline
benchmarks show performance gains and user engagement rises post deployment, but isolating cause from effect remains difficult. Simultaneous marketing, media coverage, and seasonal demand obscure whether model updates truly drive engagement gains. This paper presents a novel causal estimation approach that leverages non uniform quality improvements across capabilities within a single model version. Because capabilities improve unevenly (e.g., strong gains in coding versus modest gains in writing), users experience varied quality depending on their task distribution. This variation in experienced quality provides causal signal for estimation. We validate this approach on synthetic data with known ground truth. The raw
estimator recovers 81% to 88% of the true effect, with the remainder lost to measurement error in usage estimates. Applying an errors in variables disattenuation adjustment (using a test retest reliability ratio mean correlation of 0.861) corrects the estimate to 1.017 (bootstrapped 95% CI: 0.915 to 1.109). By contrast, naive methods fail significantly, recovering only 63% without version controls and 62% using real time rather than frozen usage patterns. Permutation tests confirm the framework distinguishes true causal effects from noise. Sensitivity analysis indicates recovery improves monotonically from 78% to 87% as pre period length increases from 3 to 7 weeks, highlighting a clear tradeoff between sample duration and
estimator precision. Seed sensitivity tests further confirm stability across random draws.
Read the full abstract ▾
Statistical Methodology · Cross-listed from math.ST
Finite-Sample Bias Correction for Plug-in Estimators of Extropy, Rényi Extropy, and Tsallis Extropy
Amadou Diadie Ba
This paper studies the finite-sample bias of plug-in
estimators for Shannon, Rényi, and Tsallis extropies for finitely supported discrete random variables. We derive explicit first-order bias formulas for all three
estimators by analyzing the bias of the intermediate functional S_\alpha = \sum_{i=1}^r (1-p_i)^\alpha. Bias-corrected
estimators are then proposed. We show that the uncorrected and corrected
estimators are asymptotically equivalent, differing only by terms of order O(1/n). A simulation study validates the theoretical results and demonstrates the superior finite-sample performance of the bias-corrected
estimators. The results justify the use of the simpler uncorrected plug-in
estimators in asymptotic settings, such as those considered in the companion paper on almost sure convergence and asymptotic normality.
Read the full abstract ▾
Statistical Methodology · Cross-listed from stat.ML
Policy Optimization and Statistical Inference for Online Contextual Matrix Games
Liner Xiang, Yixin Wang and Hengrui Cai
Online decision making often requires navigating a landscape shaped by both dynamic contexts and strategic interactions. In competitive pricing, for example, hotels must account for both dynamic contextual factors and rivals' strategic responses. Existing approaches address only part of this challenge: contextual bandits optimize single-
agent decisions using observable features but ignore multi-player interactions, while online
matrix games capture strategic behavior through Nash
equilibrium but assume fixed payoffs, ignoring contextual information. How should
agents act then when strategic payoffs evolve with contextual signals? We introduce online contextual
matrix games to integrate contextual information into multi-player online games. We further propose OnGameLearn, an online learning
algorithm that efficiently balances exploration and exploitation across both player actions and contexts. This approach comes with statistical guarantees: tail bounds for the estimated payoff
matrix, the convergence of the estimated Nash
equilibrium, the asymptotic normality of the parameter
estimators, and the sublinear regret bound. We also develop the notion of policy value in
matrix games and develop a doubly robust, $\sqrt{T}$-consistent
estimator for it. Across simulated studies and a real-world hotel pricing application, we find that OnGameLearn effectively navigates the intertwined challenges of strategic and contextual decision-making.
Read the full abstract ▾
Statistical Methodology
Incorporating Animal Movement into Continuous-Time Spatial Capture-Recapture Models
Clara Panchaud, Ruth King, David Borchers et al. (+1 more)
Estimation of wildlife population size and spatial dynamics is central to ecology and conservation. Spatial capture-recapture (SCR) models estimate abundance, using detections at sensors such as camera traps, by linking detection probability to the distance between detectors and latent individual activity centres. However, standard SCR formulations assume detections are conditionally independent over time given activity centres without explicitly modelling movement between detection events. This assumption can be problematic when individuals exhibit movement-driven dependence in detections, potentially leading to biased inference on population size. We address this important issue by developing a continuous-time framework that integrates movement into spatial capture-recapture. Individual movement is modelled as a continuous-time Markov chain over a discretised landscape, and detections arise as state-dependent Poisson events. This yields a Markov-modulated marked Poisson process representation, in which detections provide information about an individual's latent location at the time of observation and allow likelihood-based inference in continuous time. We show through simulation studies that ignoring movement-driven dependence can lead to positively biased estimates of population size, whereas the proposed model recovers unbiased estimates and provides additional inference on space use. An application to camera-trap data of American martens illustrates how the framework yields new insights into movement and density. These results demonstrate that explicitly modelling movement is critical for reliable inference in spatial capture-recapture studies.
Read the full abstract ▾
All authors Clara Panchaud, Ruth King, David Borchers, Hannah Worthington
Statistical Methodology
Biophysics-informed deep operator learning for inverse problems with application to electrophysiological source reconstruction
Eardi Lila, Erica R. Peterson, Alexis N. Bosseler et al. (+2 more)
Electrophysiological
brain signals are typically acquired through indirect and noisy measurements, providing transformed representations of the underlying neural activity. Source reconstruction—the inverse problem of resolving underlying neural signals from these measurements—is essential for mapping
brain function but remains challenging because it is ill-posed and sensitive to noise. Deep learning methods have shown promise across a range of inverse problems, yet many do not explicitly incorporate the biophysical principles governing data generation, limiting data efficiency and adaptation across subjects. Here, we introduce DeepOp-Informed, a biophysics-informed
geometric deep operator learning framework that embeds the biophysics of the sensing process into the model through a custom differentiable layer, enabling more efficient learning and improved reconstruction performance. This layer enables the neural network to adapt to subject-specific variations in the physics of signal generation, resulting from differences in
brain anatomy and sensor positioning. In realistic magnetoencephalography simulations, DeepOp-Informed generalizes to forward models from held-out subjects, reducing reconstruction error relative to several neural-network and classical baselines. Applied to adolescent auditory-evoked recordings, it produces anatomically plausible reconstructions localized to the auditory cortex. While our application focuses on magnetoencephalography, the framework is general and may be adaptable to other imaging modalities.
Read the full abstract ▾
All authors Eardi Lila, Erica R. Peterson, Alexis N. Bosseler, J. Nathan Kutz, Samu Taulu
Statistical Methodology
Pattern-Based Sequential Multiple Imputation for Missing Data in Clinical Trials: An Extension for Baseline-Only Early Dropout Subjects
Chen Zhang, Junyu Nie, Kexuan Li et al. (+1 more)
Under the ICH E9 (R1) addendum, treatment policy strategies for intercurrent events target the treatment effect regardless of treatment discontinuation. Sequential multiple imputation (MI) models that condition each visit's imputation on discontinuation status or pattern reduce bias relative to mixed models and standard MI, but require every subject to contribute at least one post-baseline observation, an assumption violated by subjects who withdraw before any post-baseline assessment, a baseline-only early dropout pattern common in chronic-disease trials. We propose Extended Pattern-based Sequential Multiple Imputation (EPSMI), which reconstructs missing data for baseline-only early dropouts using
covariate-matched, same-arm donors before applying an extended discontinuation-pattern indicator within eight sequential MI models. Two strategies were evaluated: EPSMI-Full, imputing the entire post-baseline trajectory from a donor, and EPSMI-Y1, imputing only the first visit and leaving later visits to the pattern-extended MI engine. A simulation study grounded in published Sjogren's syndrome trials evaluated bias, coverage, precision, power, and Type I error across 24 scenarios, comparing EPSMI against MMRM, standard MI, and sequential MI after excluding early dropouts (No Early). Under random early dropout, both EPSMI strategies reduced bias relative to No Early. Under informative early dropout the strategies diverged: EPSMI-Y1 remained robust, matching or exceeding No Early coverage with only mild Type I error inflation, whereas EPSMI-Full's deterministic reconstruction produced larger bias, narrower intervals from underestimated variance, lower coverage, and clear Type I error inflation. EPSMI-Y1 is recommended as the primary analysis strategy for baseline-only early dropout, keeping estimation faithful to the treatment policy estimand over the full randomized population.
Read the full abstract ▾
All authors Chen Zhang, Junyu Nie, Kexuan Li, Ning Ding
Statistical Methodology
NP-LEAP: Nonparametric Latent Exchangeability Prior for Model-Lean Borrowing from Historical Data
Ethan M. Alt, Miheer Dewaskar, Jacob M. Maronge et al. (+2 more)
Bayesian dynamic borrowing (BDB) methods leverage historical data to reduce treatment effect uncertainty, yet existing approaches rely on parametric outcome models susceptible to misspecification. We propose the nonparametric latent exchangeability prior (NP-LEAP), an outcome-agnostic, assumption-lean framework to borrow information from historical data. The NP-LEAP performs individual-level exchangeability assessment, inducing
Bayesian model averaging over all possible partitions of the historical data into exchangeable and nonexchangeable subsets. Although applicable to a variety of data types with choice of appropriate kernel, the NP-LEAP is particularly well-suited for studies with time-to-event outcomes, where parametric BDB is potentially triply misspecified - imposing a parametric baseline hazard, the proportional hazards structure, and blanket exchangeability. We establish posterior consistency under mild regularity conditions. Simulation studies demonstrate favorable operating characteristics relative to parametric borrowing methods and nonborrowing semiparametric frequentist methods. We illustrate the method by augmenting the control arm in a randomized trial of patients with non-small
cell lung cancer.
Read the full abstract ▾
All authors Ethan M. Alt, Miheer Dewaskar, Jacob M. Maronge, Yuelin Lu, Matthew A. Psioda
Statistical Methodology · Cross-listed from stat.CO
Bessel-Debiased Pseudo-Marginal MCMC for Generalised Bayesian Inference
Yingkai Lu, Jeong Eun Lee and Geoff K. Nicholls
Generalised
Bayesian inference uses weights of the form $\exp\{-\beta_n\ell_n(\theta)\}$ even when the loss is only estimated. Exponentiating an unbiased loss estimate changes the target, and when $\beta_n\asymp n$ an ordinary Monte Carlo loss estimate with variance of order $M^{-1}$ requires a per-proposal budget $M$ of order $n^2$ to keep the leading log-weight variance bounded. We introduce Sign-Corrected Bessel Debiasing (SCBD), a signed pseudo-marginal method based on independent block estimates of the loss, and study its ordinary-MC and independently randomised quasi-Monte Carlo (RQMC) implementations. Under an i.i.d. Gaussian block model, a Bessel factor constructed from the block sample variance exactly removes the Gaussian exponential inflation despite the variance being unknown. For general non-Gaussian finite blocks, the method targets a posterior differing from the intended posterior by a parameter-dependent multiplicative factor. Under regularity conditions, the uncorrected and corrected ordinary-MC targets have total-variation errors of orders $\beta_n^2/M_n$ and $\beta_n^3/M_n^2$. If an RQMC block
estimator has variance $\mathcal O\{B^{-\alpha}(\log B)^{d-1}\}$, the corresponding errors are of orders $\delta^{\mathrm{RQ}}_{n,M_n}$ and $(\delta^{\mathrm{RQ}}_{n,M_n})^{3/2}$, where $\delta^{\mathrm{RQ}}_{n,M_n}=\beta_n^2M_n^{-\alpha}{\log(2+M_n)}^{d-1}$. The same variance rate gives a sufficient budget of order $n^{2/\alpha}$, up to logarithmic factors, for bounded leading log-weight variance when $\beta_n\asymp n$. The numerical examples show that favourable RQMC representations can inherit this budget scaling and that variance reduction and Bessel correction are complementary. Compared to existing exact corrections, Bessel debiasing is essentially "for free". It is generic, easy to code and supported by theory.
Read the full abstract ▾
Statistical Methodology
Bayesian epidemic alignment for causal evaluation of seasonal infectious-disease interventions
David Moriña
Seasonal infectious-disease interventions are commonly evaluated with interrupted time-series or pre–post designs that align epidemics by calendar week. When epidemic onset, speed or peak timing differs between seasons, such comparisons confound a shift in epidemic phase with a change in disease burden. We propose a
Bayesian causal count model in which season-specific affine transformations map calendar time to a latent epidemic clock, and intervention effects are estimated on that clock rather than on the calendar. The
alignment is a model component rather than a preprocessing step, so uncertainty about epidemic timing propagates into every causal contrast. The model uses a negative-binomial observation distribution, hierarchical area, season and area-season effects, a shrunk
Fourier epidemic curve, and a continuous programme-intensity exposure. Posterior g-computation yields prevented cases, prevented fractions, peak attenuation and epidemic displacement, under both a controlled contrast and a dynamic contrast that propagates disease history within each arm. A two-tier simulation study evaluates bias, root mean squared error, interval coverage and parameter recovery under stable timing, epidemic-clock variation, intensity-dependent ascertainment and area-level confounding. We illustrate the framework using open Catalan primary-care surveillance and respiratory syncytial virus immunisation data, with explicit
attention to the overlap in programme intensity that identifies the effect.
Read the full abstract ▾
Statistical Methodology
Randomization inference for treatment effects on survival outcomes
Lucy D'Agostino McGowan, Joseph Rigdon, Xinran Li et al. (+1 more)
The log-rank test and Kaplan–Meier plot are standard tools for analyzing time-to-event data in randomized clinical trials, yet neither provides a summary of the magnitude of the treatment effect. Practitioners typically fill this gap by reporting a hazard ratio from a Cox proportional-hazards model or an acceleration factor from an accelerated failure time (AFT) model, but both require assumptions beyond those needed for the log-rank test or Kaplan–Meier
estimator. We propose two nonparametric confidence intervals for scalar effect-size summaries, an additive shift c and a multiplicative factor $\rho$, obtained by inverting the log-rank test under sharp null hypotheses of constant treatment effects. Building on the randomization-inference framework of Li and Small (2023), both intervals are valid under the randomization distribution alone, requiring no assumptions for the event-time distribution. We evaluate the proposed multiplicative interval via simulation, finding that it maintains nominal coverage across a range of censoring rates and sample sizes, including under data-generating processes that misspecify a parametric AFT model, while incurring only a modest efficiency loss compared to parametric AFT inference under correct specification. We illustrate the approach using data from a randomized trial of rhDNase for cystic fibrosis and provide R code and a Shiny application for ease of implementation.
Read the full abstract ▾
All authors Lucy D'Agostino McGowan, Joseph Rigdon, Xinran Li, Dylan Small
Statistical Methodology · Cross-listed from stat.ML
Density-Reweighted Entropic Optimal Transport: Decoupling Geometry from Sampling Density
Keyi Li, Yuval Kluger and Boris Landa
Dataset alignment is a central step in data analysis across science and engineering, where the goal is to match observations between
datasets. Entropic Optimal Transport (EOT) offers a computationally tractable framework for this task by encoding cross-
dataset affinities in a transport plan. However, when two
datasets are sampled from geometrically similar low-dimensional structures with substantially different sampling densities, the EOT plan may match points by relative sampling density rather than
geometric proximity, yielding geometrically misleading correspondences. To address this issue, we propose a density-reweighted EOT framework in which the influence of sampling density on the transport plan can be discounted to a desired degree, ranging from standard EOT to
alignment driven purely by underlying geometry. Under suitable regularity conditions, we establish convergence of the reweighted EOT plan to a family of population-level plans whose dependence on sampling density is made explicit. Through simulations, we show that our approach recovers geometrically faithful correspondences, improving over related EOT-based frameworks when
datasets exhibit substantial sampling density disparity.
Read the full abstract ▾
Statistical Methodology
Deep adaptive design with an evidential bias criterion
David Chen, Michael Evans, Xinwei Li et al. (+2 more)
Bayesian optimal experimental design (BOED) aims to collect informative data by optimizing an expected utility reflecting the goals of an experiment. However, this optimization is computationally challenging for common utilities and complex models. This is especially so for sequential or adaptive designs, where design and data collection alternate, so that feedback from already observed data must be taken into account. Most existing BOED research employs information gain as the utility, leading to the expected information gain (EIG) criterion. While EIG is widely useful, it may not always adequately reflect experimental goals. EIG can be viewed as rewarding experiments that produce large positive evidence for the truth on average, but it does not directly control the risk of an experiment producing misleading evidence. Here we consider an alternative criterion, which we call bias against (BA), that prioritizes such control. To address computational challenges when applying this criterion for adaptive design, we consider a policy-based deep adaptive design framework, which has previously been used for the EIG criterion. Minimizing a tractable upper bound on the BA objective is equivalent to maximizing a variance-penalized EIG criterion, and we optimize the latter by approximating it by Monte Carlo and learning design policies using
stochastic gradient methods. The differences between BA and EIG designs are demonstrated in several examples including the adaptive design of a complex discrete choice experiment.
Read the full abstract ▾
All authors David Chen, Michael Evans, Xinwei Li, Prateek Bansal, David J. Nott
Statistical Methodology · Cross-listed from stat.CO
Stable Matrix Parametrizations and Structured Adjoints for Ornstein-Uhlenbeck Processes
Filippo Monti, Andrew Holbrook, Nathan E. Glatt-Holtz et al. (+1 more)
Ornstein-Uhlenbeck processes with flexible multivariate drift
matrices are powerful models for capturing coupled, asymmetric, and damped-oscillatory mean reversion. However, likelihood-based inference is challenging because the drift
matrix must remain Hurwitz stable, while likelihood and gradient evaluations require repeated, costly computation and differentiation of the drift
matrix exponential and of solutions to the associated Lyapunov equation. We introduce the Hurwitz smooth spectral block parametrization (H-SSBP), which represents the drift as a change of basis applied to independent one- and two-dimensional stable blocks. Simple scalar constraints enforce Hurwitz stability, while the two-dimensional blocks vary smoothly between real- and complex-
eigenvalue regimes, avoiding discrete model selection. The H-SSBP represents every real Hurwitz
matrix diagonalizable over the complex numbers and has dense, full-measure support within the Hurwitz cone. Its block structure reduces the OU transition
matrix, stationary and innovation covariances, and their reverse-mode derivatives to constant-size block or block-pair computations plus change-of-basis multiplications. Numerical experiments demonstrate dramatic speed-ups over alternatives, particularly for
matrix-exponential adjoints and Lyapunov-equation kernels. Real-data analyses of asynchronous financial data and multivariate phylogenetic traits illustrate the proposed framework in practice.
Read the full abstract ▾
All authors Filippo Monti, Andrew Holbrook, Nathan E. Glatt-Holtz, Marc A. Suchard