Statistical Methodology · Cross-listed from math.PR
Gumbel convergence for maximal packing distances from uniform random samples
Sana Louhichi
Let $(X _n )_n$ be a sequence of i.i.d. $R^d$-valued random variables uniformly distributed on a compact subset $M$ of $R^d$ . In this work, we study the asymptotic behavior of maximal packings of this compact subset $M$. Under some assumptions on $M$ (in particular, that it is a smooth submanifold of $R^d$ without boundary), we establish a precise extreme value law (of Gumbel type) for the minimal distances from the sample $(X_1 , \cdots, X_ n)$ to the centers of maximal packings. This result leads to explicit asymptotic confidence bounds for this maximal packing and thus to the support $M$. A distinctive feature of our contribution is the explicit derivation of the scaling sequences in the Gumbel convergence, depending only on the geometry of the support M. These formulas provide interpretable confidence bounds for $M$, which represent a novel complement to previous approaches such as those by Fasy et al. (2014). Our approach bridges
geometric and combinatorial probability arguments and relies on analytic tools such as the Lambert $W$ function. In addition, we provide examples of main sample spaces in directional and circular statistics (circle, sphere,
torus), along with simulations that illustrate and support the theoretical findings.
Read the full abstract ▾
Statistical Methodology · Cross-listed from econ.EM
When is statistical evidence strong enough? Using hypothesis tests to value data collection
Aristotelis Epanomeritakis and Davide Viviano
Policy decisions often hinge on conventional p-value thresholds, which ignore economic costs and benefits of further data collection. This paper recasts statistical significance as a choice between making an immediate policy recommendation and deferring it until further evidence is collected. The welfare-optimal decision corresponds, under minimax regret, to a statistical test whose level depends on the cost and precision of additional evidence. Inverting this rule, we introduce and recommend reporting the abstention-value (A-value) to determine where additional data collection is most needed. The A-value defines the break-even welfare cost of abstaining and recommending further experimentation given the initial evidence. Computing the A-value only requires a point estimate and its standard error, imposes no prior assumptions on policy effects, and can be converted to a monetary research budget using inputs already frequently used by regulators and funding agencies. When experimentation capacity is limited, we show that prioritizing additional data collection where A-values are the largest yields strong finite-sample guarantees. Applications to anti-poverty programs and to a medical study illustrate the practical benefits of using A-values.
Read the full abstract ▾
Statistical Methodology
Differentially Private Average Treatment Effect Estimation by Propensity Score Blocking
Duncan Stewardson, Grayson W. White and Adam Groce
Average treatment effect (ATE) estimation in observational studies is a fundamental statistical tool used frequently in social science, medicine, and other fields. These fields often work with sensitive data where
privacy protections are important, so a differentially private mechanism for ATE estimation is highly desirable. Here we present two propensity score-based
algorithms for ATE estimation on observational data, one improving the inverse probability weighting (IPW) method used in prior work, and the other using blocking on the propensity score (BPS). Both show lower error and less bias than prior work, with the BPS-based
algorithm frequently reducing error by 75% or more compared to prior work.
Read the full abstract ▾
Statistical Methodology
Differential Privacy Guarantees in Small Area Estimation
Soumojit Das and Jörg Drechsler
Statistical agencies increasingly rely on small area estimation to produce reliable estimates for subpopulations with limited sample sizes. These estimates are built from individual survey responses, so agencies must ensure that releasing them does not reveal information about any single respondent. We show that when a single draw from the posterior distribution of the
Bayesian Fay-Herriot model is released, pure $\varepsilon$-differential
privacy is unattainable, but the release satisfies formal
privacy guarantees under Rényi differential
privacy and zero-concentrated differential
privacy without any noise being added, provided we treat the variance components as fixed. The key insight is that the posterior draw equals the posterior mean plus the Gaussian noise whose variance equals the posterior variance. The guarantee is thus governed by the sensitivity of the direct survey estimate and the posterior variance, and applies equally to a release of the posterior mean with that amount of noise added. For binary outcomes estimated with the Hájek
estimator, the sensitivity equals the largest survey weight in the area divided by the sum of the weights. For the intercept-only model we derive exact coefficients describing how a change in one record propagates to every area's posterior mean, giving finite-sample per-area guarantees and a joint guarantee for releasing all areas at once that exceeds the largest per-area guarantee by at most a few percent in our applications. Two applications, poverty prevalence across 2,462 Public Use Microdata Areas in the American Community Survey and smoking prevalence across 52 substrata in the Washington state Behavioral Risk Factor Surveillance System, show that the guarantee is driven far more by the inequality of the survey weights than by the sample size, and that the shrinkage of the model tightens it substantially.
Read the full abstract ▾
Statistical Methodology
Covariate-localized False Discovery Rates
Jonathan Lin and Surya Tokdar
We introduce a flexible model for
covariate-dependent multiple testing which can be encoded using a nonparametric Gaussian mixture model. Weight-localized predictive recursion (PRx), a new development in the methodology of Newton's predictive recursion
algorithm, is then leveraged to estimate the components of this mixture model, allowing for recovery of the
covariate-localized false discovery rate $\text{Pr}(H_i = 0|z_i,x_i)$ using a single, unified
algorithm. This quantity represents the most direct extension of Efron's local false discovery rate to the
covariate-dependent setting, and admits provable
Bayesian FDR control properties under simple rejection rules. We introduce several procedures for estimating and thresholding the local false discovery rate, and show using various simulations and a real-data example that our procedures lead to increased power, tighter
Bayesian FDR control, and more interpretable rejections. We furthermore show that this holds for fixed and randomized hypothesis labels, indicating that our proposed methods perform well under both frequentist and
Bayesian interpretations of multiple testing.
Read the full abstract ▾
Statistical Methodology · Cross-listed from math.ST
MiNCE: Nonparametric, Strongly Consistent Confidence Envelopes for Band-Limited Functions and their Smoothed Spectra
Balázs Csanád Csáji and Bálint Horváth
Minimum-norm confidence envelope strategies offer a nonparametric approach to constructing nonasymptotic, simultaneous confidence regions for band-limited functions, exploiting the theory of Reproducing Kernel
Hilbert Spaces (RKHS). While the finite-sample coverage guarantees of these envelopes have been established, their consistency has not been analyzed so far. In this paper, we study this construction, here termed the Minimum-Norm Confidence Envelope (MiNCE) framework, and establish the strong uniform consistency of the resulting bands, both for noise-free and noisy observation models, under mild assumptions on the measurement noises. We further extend this formulation to the frequency domain, deriving nonasymptotic, simultaneous, strongly uniformly consistent confidence bands for the smoothed spectra. Numerical experiments in nonparametric regression and spectral estimation empirically confirm our theoretical results, illustrating the contraction of the confidence envelopes toward the target function as the sample size increases.
Read the full abstract ▾
Statistical Methodology
Semiparametric Receiver Operating Characteristic Analysis in the Presence of an Imperfect Reference Standard via a Box-Cox Density Ratio Model
Yi Chang, Siyan Liu, Qinglong Tian et al. (+1 more)
Receiver operating characteristic (ROC) analysis is commonly used to evaluate the diagnostic accuracy of continuous biomarkers. In practice, the true disease status may be unavailable and only a nominal disease status provided by an imperfect reference standard is observed. Existing nonparametric methods have been developed for ROC analysis in this setting, but may suffer from reduced estimation efficiency, numerical instability, or sensitivity to the choice of biomarker scale. We propose a semiparametric method based on a Box-Cox density ratio model, which links the biomarker distributions of the truly healthy and diseased populations while leaving the baseline distribution unspecified. A key feature of the proposed method is that the transformation parameter is estimated from the data rather than specified in advance, allowing the density-ratio structure to adapt to different transformation scales. We develop an empirical likelihood approach for estimation and an expectation-maximization
algorithm for computation. We establish the asymptotic distributions of
estimators of the ROC curve, area under the curve, Youden's index, and the sensitivity and specificity at the Youden-optimal cutoff, and develop bootstrap confidence intervals and a goodness-of-fit test. Simulation studies demonstrate that the proposed method provides accurate and numerically stable estimation and inference across a range of distributional settings without requiring the transformation scale to be specified in advance. The proposed method is illustrated using data from a malaria study.
Read the full abstract ▾
All authors Yi Chang, Siyan Liu, Qinglong Tian, Pengfei Li
Statistical Methodology
A Counterfactual Framework for Estimating Infectious Disease Prevalence under Repeated Testing with Symptomatic and Contact-Tracing Components
Jeongjin Lee, Junke Yang, Grzegorz A. Rempala et al. (+1 more)
This paper addresses the problem of estimating infectious disease prevalence under longitudinal testing programs that include scheduled, symptomatic, and contact-tracing testing. Our study is motivated by data from The Ohio State University, where a mandatory once-per-week COVID-19 testing and isolation program was implemented during the Fall 2020 semester, supplemented by additional testing for symptomatic individuals and identified contacts. In this setting, the probability of being tested depends on symptoms or contact-tracing status, creating a complex observation process. We develop a counterfactual framework that links the observation process to a hypothetical process in which infection is prevented. This formulation enables unbiased estimation of disease prevalence by modeling the testing process, possibly nonparametrically, without requiring explicit modeling of transmission dynamics, even though the testing and infection processes are jointly dependent.
Read the full abstract ▾
All authors Jeongjin Lee, Junke Yang, Grzegorz A. Rempala, Patrick M. Schnell
Statistical Methodology
Estimating Causal Treatment Effects in Placebo-Controlled Randomized Clinical Trials When High Placebo Response is Anticipated
Yang Song, Yunzhe Qian, Chanmin Kim et al. (+1 more)
In placebo-controlled randomized clinical trials (RCTs), the placebo response significantly modifies treatment effects and diminishes the intention-to-treat (ITT) treatment effect, $\Delta_{ITT}$. This study presents a novel two-stage framework for estimating the standardized causal treatment effect, $\Delta_{STD}$, among the ITT population, under the assumption that their placebo responses are similar to the levels of self-administering medication at home. The first stage employs a real-world, pragmatic, single-blinded placebo lead-in to measure placebo responses to levels expected during routine at-home use. This is achieved by preserving the participants' expectations and controlling for trial-related factors that inflate the responses. In the second stage, a double-blinded randomized phase is used to estimate the conditional average treatment effect (CATE) as a function of placebo response levels and other important effect modifiers. To facilitate CATE estimation, the prognostic scores, defined as the expected placebo responses, are used for dimension reduction. The causal estimand $\Delta_{STD}$ is computed by integrating the CATE function over the distribution of the expected placebo response levels from stage one and other modifiers. We further derive theoretical values for $\Delta_{ITT}-\Delta_{STD}$ to quantify the underestimated treatment benefit due to high placebo responses. The validity and statistical performance of the proposed framework are evaluated through comprehensive simulations.
Read the full abstract ▾
All authors Yang Song, Yunzhe Qian, Chanmin Kim, Gheorghe Doros
Statistical Methodology
Real-time and adaptive anomaly detection algorithm for cyclostationary models
Justyna Witulska, Tomasz Barszcz, Ireneusz Jabłoński et al. (+1 more)
This article introduces PeriodicCALM, an effective real-time anomaly detection framework designed for cyclostationary data streams. While classical cyclostationary processes feature periodically time-varying statistical properties, real-world signals often contain recurring impulsive components that conceal abnormal behavior. Existing real-time methods for struggle with these dynamics, frequently misinterpreting phase-dependent variability as non-cyclic anomalies and causing excessive false alarms. To address this, PeriodicCALM incorporates cycle-dependent variability to systematically ignore regular cyclic impulses while accurately isolating genuine anomalies. Operating in real time with continuous retraining capabilities, the method adapts dynamically to evolving signal characteristics. Comparative evaluations against the baseline CALM framework using simulated data demonstrate significant improvements in detection accuracy and training efficiency, alongside a reduction in prediction latency. Furthermore, the practical utility of PeriodicCALM is validated on real-world vibration signals collected from a compressor monitoring system.
Read the full abstract ▾
All authors Justyna Witulska, Tomasz Barszcz, Ireneusz Jabłoński, Agnieszka Wyłomańska
Statistical Methodology
Kalman Filtering and Smoothing for Improving Precision in Horvitz–Thompson Estimation of Infectious Disease Prevalence
Jeongjin Lee, Grzegorz A. Rempala and Patrick M. Schnell
Horvitz–Thompson (HT)
estimators can provide unbiased daily estimates of infectious disease prevalence under repeated surveillance by correcting for nonrandom testing induced by scheduled, symptom-based, and contact-tracing components. However, because each HT estimate is based on the testing data available for that day and may involve highly variable inverse probability weights, it can be noisy, have precision that varies over time, and become unavailable during temporary interruptions in testing. The daily HT
estimator is modeled as a noisy observation of an underlying prevalence process, with day-specific observation variances estimated using a delete-a-group jackknife. Our primary specification is a joint local linear trend state-space model that extends the standard level-only random walk by adding a latent slope. The Kalman filter improves precision by borrowing information from past estimates. At each time $t$, the process variances are estimated or carried forward using only observations available through time $t$, so the resulting filtered estimate is available in real time. We also describe the corresponding Kalman smoother as a retrospective extension based on the full observed series. When daily HT estimates are missing, the Kalman filter proceeds through prediction-only updates, whereas the corresponding smoother retrospectively reconstructs those periods using later observations. In simulations, the joint Kalman filter substantially improves precision relative to the raw daily HT
estimator while preserving the main temporal pattern, and the smoother provides a more stable retrospective summary. In The Ohio State University's fall 2020 SARS-CoV-2 surveillance data, the filter and smoother provide estimates on no-testing days, when the HT
estimator provides neither point nor interval estimates, and yield narrower confidence intervals than HT intervals on observed days.
Read the full abstract ▾
Statistical Methodology · Cross-listed from cs.LG
Accountable and uncertainty-aware evaluation of sensor-based AI under distribution shift: devices, subjects, and nearly three years underground
Benny Platte, Rico Thomanek, Christian Roschke et al. (+1 more)
Sensor-based AI systems are rarely operated under the conditions under which they were trained: devices, personnel and recording epochs change, and each change degrades performance in ways a random train-test split cannot reveal. We propose a staged, accountable evaluation protocol that treats the evaluation of a deployed model as a measurement with declared reference levels and a quantified uncertainty. Four cumulative generalisation stages hold out devices, subjects and time. Each stage is judged on
quantiles of repeated trainings against chance references with the correct class count, an out-of-present-scope rate exposes silent misdirection towards classes that are no longer present in deployment relative to training, and an explicit decision rule ties roll-out decisions not to means but to 5%
quantiles. We demonstrate the protocol on infrastructure-free geomagnetic localisation with smartphone-based recurrent classifiers in two real underground mines, including a replication of the scheme's training stages at the second site. Unchanged models are re-evaluated on data recorded 34 months after the training campaign, on a device generation unknown at training time and with a held-out surveyor. The 5%
quantile of their present-conditioned precision there is 0.39 over 299 repeated trainings, 16.5 times the chance level; across the composition of the 42 reachable location classes the figure varies by +/-0.08, several times the spread between repeated runs. Repeated trainings of a single configuration show why means mislead: a bimodal configuration passes a mean-based test decisively while its 5%
quantile lies more than an order of magnitude below chance.
Read the full abstract ▾
All authors Benny Platte, Rico Thomanek, Christian Roschke, Marc Ritter