Statistics Applications · Cross-listed from stat.ME
Three Routes to One Answer: Reconciling AIPW, TMLE, and Double Machine Learning for Applied Researchers
M. Ehsan Karim
Augmented inverse-probability weighting (AIPW), targeted maximum likelihood estimation (TMLE), and double/debiased machine learning (DML) are three routes to the same efficient influence function for the average treatment effect — settled theory we treat as background. This tutorial's contribution is its worked, shared-nuisance reconciliation on real data: what a practitioner must actually match for the routes, and the software packages, to agree. Working the effect of smoking cessation on weight change in the open NHEFS data (n=1566) with one shared Super Learner library and identical cross-fitting folds, we build all three
estimators by hand from one influence function, in full-sample, cross-fit, and double-cross-fit variants; the six resulting doubly-robust estimates span only 3.32–3.42 kg, consistent with the established
benchmark. We then reconcile the same estimand across our engine and the tmle, AIPW, DoubleML, and tmle3 packages. At their defaults the estimates span 3.32–3.49 kg. Once the library and folds are matched and single-split noise is averaged out, the three library-sharing implementations agree to within 0.01 kg — so the residual spread traces to the nuisance library, folds, and repetitions, not to the
estimator label. Because the
estimators share one influence function, they agree under good overlap; under a positivity violation the pooled ATE is not identified without additional extrapolation assumptions, and their finite-sample estimates can then diverge sharply. We therefore place a positivity diagnosis ahead of
estimator choice, illustrate the failure on a no-overlap example, and close with a reporting checklist. Open-source R code reproduces every number.
Read the full abstract ▾
Statistics Applications
Real-time anomaly detection in base station testbeds via scalable kernel density estimation framework
Justyna Witulska, Marcin Szczukiewicz, Artur Tabaka et al. (+4 more)
Large-scale testing infrastructures are critical for validating telecommunication systems, yet their growing complexity makes efficient resource utilization and anomaly detection increasingly challenging. In reservation-based testbed environments, errors in resource allocation or preparation often manifest as abrupt spikes or regime changes in time-based metrics. This paper proposes a scalable, unsupervised framework for real-time anomaly detection in such environments. We introduce CALM (Continuous Anomaly Localization for univariate and Multivariate data), a nonparametric method based on kernel density estimation and bootstrap-based thresholding, designed for anomaly detection at the individual testbed level. To address system-wide visibility, we further propose AggCALM, an aggregation framework that consolidates local anomaly signals across multiple testbeds to detect statistically significant global anomalies while mitigating alarm fatigue. The methodology is evaluated using simulated multivariate data and real-world data from a large-scale base station testing platform. Results demonstrate that the proposed framework enables timely, flexible, and accurate anomaly detection without requiring labeled data, supporting reliable operation of complex test environments. Although the proposed methodology is presented within the context of a telecommunication testing labs, it can be effectively used to other applications, such as condition monitoring, where anomaly detection serves as a pivotal pre-processing step for diagnostic signals.
Read the full abstract ▾
All authors Justyna Witulska, Marcin Szczukiewicz, Artur Tabaka, Rafał Sarniak, Ireneusz Jabłoński, Agnieszka Wyłomańska, Dominik Dulas
Statistics Applications
A Gaussian Process Model of 3D Udder Point Clouds for Teat Length Phenotyping in Dairy Cows
Maria E. Montes, João R. R. Doréa and Christopher J. Geoga
Phenotyping conformation traits is important for dairy cattle breeding and management. Although large-scale phenotyping is possible with 3D imaging technologies, manual annotation of anatomical landmarks and long run times prevent full pipeline automation. In particular, the morphological heterogeneity of cow udders makes automated detection of teat landmarks challenging. To address this limitation, we propose and evaluate a method for teat length estimation from udder point clouds with a Gaussian process. We model the vertical coordinates as the sum of a Gaussian process representing the udder floor and an unknown function representing the teat. Since the udder floor process is smooth and has a significantly wider dependence lengthscale than the teat function, this model allows separating the two terms needed for teat landmark definition. To ensure computational feasibility, we implement a low-rank approximation of the covariance
matrix, reducing the computational complexity of the method from $\mathcal{O}(n^3)$ to $\mathcal{O}(n)$. This approach is both faster and more accurate than existing methods, reducing RMSE by a factor of two. It is also more robust to uncommon udder morphologies, making it better suited for automated phenotyping of large numbers of individuals.
Read the full abstract ▾
Statistics Applications · Cross-listed from eess.SY
Source-Agnostic Sizing of Flexibility Reserves
Napoleon Costilla-Enriquez, Miguel A. Ortega-Vazquez, Aidan Tuohy et al. (+1 more)
Growing shares of variable renewable energy sources (VRES) increase forecast uncertainty and variability, requiring flexibility reserves that adapt to changing operating conditions and reflect the likelihood and severity of forecast deviations. Conventional fixed-rule or Gaussian approaches misrepresent asymmetric, heavy-tailed errors, leading to inefficient procurement or optimistic risk estimates. This paper presents a source-agnostic framework that constructs conditional error distributions for load, wind, and solar from historical deviations or probabilistic forecasts, combines them into a conditional net-load error distribution, and derives upward and downward reserves using coverage- and risk-based criteria. Nonparametric density estimation captures empirical error behavior without a parametric assumption, while a Conditional Value-at-Risk (CVaR)-based metric quantifies expected uncovered deviations. Experiments on a New York Independent System Operator (NYISO)-based synthetic
dataset show that the framework meets target coverage with lower reserve volumes than static
benchmarks and avoids the tail-risk distortion of Gaussian-based methods. Because reserves are built directly from the resource uncertainty distributions, the framework is transparent and interpretable, and it integrates seamlessly into existing production-cost models as deterministic reserve constraints, avoiding scenario-based
stochastic optimization. It is implemented in the Electric Power Research Institute's (EPRI) DynADOR tool for operational reserve scheduling.
Read the full abstract ▾
All authors Napoleon Costilla-Enriquez, Miguel A. Ortega-Vazquez, Aidan Tuohy, Erik Ela
Statistics Applications · Cross-listed from cs.DL
StatCite: A Large-scale Citation Network Dataset for Statistics and Data Science
Tianang Deng, Tianchen Gao, Rui Pan et al. (+1 more)
In this paper, we introduce StatCite, a large-scale citation network
dataset covering publications in statistics and data science from 1981 to 2025. The
dataset contains 189,101 research articles collected from 62 representative journals and provides bibliographic metadata, including title, author list, publisher, published year, abstract, keywords, and reference list. Based on the collected publications, we construct four complementary citation-based networks, namely the paper citation network, the co-citation network, the bibliographic coupling network, and the journal citation network. To illustrate the utility of the
dataset, we present descriptive analyses of the constructed networks and investigate the community structure of the paper citation network. The results show that StatCite preserves key structural characteristics commonly observed in large-scale citation networks and captures several major research areas in statistics and data science. By integrating multiple network representations with rich textual metadata, StatCite provides a valuable resource for statistical analysis, knowledge discovery, and data-driven studies of scientific literature.
Read the full abstract ▾
All authors Tianang Deng, Tianchen Gao, Rui Pan, Yan Zhang
Statistics Applications
Evaluating for the long term: Learnings from industry
Leif Sigerson, Tom Cunningham, Winston Chou et al. (+22 more)
Online platforms prioritize long-term business outcomes, yet typical experiments are far too short to measure these outcomes directly. Our goal in this paper is to collect and share industry knowledge on how to make decisions from short-term experiments that are better aligned with long-term outcomes. Based on a daylong workshop with 26 experts from 15 online platforms and 4 universities, we formulate a series of propositions that reflect current industry knowledge. Participants largely agreed that reversals of sign from short-run to long-run treatment effects are rare, with reversals concentrating in specific cases such as treatments involving content quality signals, hyper-monetization, and pricing. Although the magnitude of treatment effects can shift over time, a "univariate autosurrogate", corresponding to the short-run treatment effect on the long-run metric of interest, is often hard to beat. A recurring theme was the importance of surrogates that are not only (or even primarily) unbiased for true long-run outcomes, but that improve decision-making. Thus, participants generally agreed that simple, interpretable surrogates were generally preferable to elaborate but hard-to-explain surrogate indices. Participants also agreed that, due to concerns about confounding and transportability, experimentally-learned surrogates are generally preferable to observationally-learned surrogates. However, the drawback is that learning good surrogates from experiments typically requires a large, representative portfolio of long-run experiments that few platforms possess. We conclude that there is no substitute for a well-run long-term experiment, whether for learning surrogates or validating them, and we highlight open challenges including evolving treatments, persistent treatments not fully mediated by short-term proxies, and mismatch between experimental samples and the target population.
Read the full abstract ▾
All authors Leif Sigerson, Tom Cunningham, Winston Chou, Sana Pandey, Jonathan Stray, Lo-Hua Yuan, Eytan Bakshy, Timothy Chan, Molly Davies, Maria Dimakopoulou, Simon Ejdemyr, Kenneth Hung, Nathan Kallus, Madhav Kumar, Thu Le, A. Demetri Pananos, Lee Richardson, Brennan Schaffner, Rose Tan, Martin Tingley, Nadia Tomova, Panagiotis Toulis, Wenjing Zheng, Zander Arnao, Dean Eckles
Statistics Applications
From Annual Throughput to Vessel Schedules: A Stochastic Generator for Transshipment Hub Simulation
Qiaohong Li, Haobin Li, Tianhao Chen et al. (+1 more)
Simulating container transshipment hubs requires vessel arrivals reflecting cyclical liner schedules and origin-destination (OD) cargo pairing. Existing models relying on Poisson arrivals and aggregate transshipment volumes severely distort waiting-time and yard-occupancy predictions. We propose a three-phase schedule generator, calibrated entirely from public port statistics, eliminating the need for proprietary data. The framework introduces a two-level Gamma mathematical model that balances structured weekly services with operational perturbations. For cargo routing, we develop GreedyDwellFit (GDF), a fast allocation heuristic to pair transshipment batches to specific connecting services using a
gravity model. Validated against Busan and Singapore mega-hubs, the model reproduces throughput and call frequencies with under 1% error. Our results show that replacing Poisson models with this Gamma-GDF framework eliminates significant distortions in terminal performance projections, offering a robust, generalisable foundation for port simulation.
Read the full abstract ▾
All authors Qiaohong Li, Haobin Li, Tianhao Chen, Ek Peng Chew
Statistics Applications
Crowd-Sourced Geographies of Income: Using Google Maps Points of Interest as High-Frequency Proxies for Sub-Municipal Income Estimation in Sao Paulo, Brazil
Adrienne C. Kinney, Anya Workman, Ademar Takeo Akabane et al. (+5 more)
Accurate, up-to-date income data at the sub-municipal scale is essential for social policy in middle-income countries, yet in Brazil it depends on a costly decennial census whose intercensal gap recently exceeded a decade. We test whether the composition of crowd-sourced Google Maps Points of Interest (POIs) can serve as a high-frequency, low-cost proxy for household income across the 26,625 census sectors of the municipality of Sao Paulo. Using a theoretically motivated set of POI categories retrieved from Google Places, we represent each sector by its POI counts, decompose these high-dimensional, sparse features with principal component analysis (PCA) and non-negative
matrix factorization (NMF), and train a sweep of regression models to predict census-derived income. Under a data leakage-aware spatial validation design the best model (NMF with gradient boosting) attains a held-out R^2 of 0.65, with performance stable across feature-extraction methods. Interpretable decompositions reveal which POI types carry the income signal. These results suggest that commercial, crowd-sourced geospatial data can complement conventional income statistics during intercensal periods, and we discuss extensions toward multidimensional poverty and the capabilities framework.
Read the full abstract ▾
All authors Adrienne C. Kinney, Anya Workman, Ademar Takeo Akabane, Jenna Barac, Paulo Fernando Braga Carvalho, Jeova Farias, Fernando Nascimento, Paulo Ricardo da Silva Oliveira
Statistics Applications · Cross-listed from stat.ME
Proximal Individualized Functional Treatment Regimes
Zhuoxin Long and Xiaoke Zhang
Estimating individualized treatment regimes (ITRs) is fundamental in data-driven personalized decision-making problems, such as precision medicine. Most of the ITR literature either focuses on categorical/continuous treatments or assumes no unmeasured confounding. In this paper, we make the first attempt to estimate the optimal individualized functional treatment regime (IFTR) for observational data where the treatment is a function and unmeasured confounding is present. We establish an identification result for a class of IFTRs under the proximal causal inference framework. Based on the identification result, we develop an
algorithm of finding the optimal IFTR. The appealing practical performance of the proposed method is demonstrated by a simulation study. The proposed method is applied to an accelerometry
dataset collected by the US National Health and Nutrition Examination Survey to find the optimal physical activity distribution for the best of the Triglyceride-Glucose index.
Read the full abstract ▾