Statistics Applications · Cross-listed from stat.ME
An Honest Effect Size for Contingency Tables: Why Nothing Can Be Unbiased, Where to Put the Error Instead, and How to Route the Report
William J. Dwyer
Cramer's V is the effect size reported beside almost every chi-square test, read against Cohen's labels, yet a large fraction of such numbers describe sampling noise and the standard bias correction (Bergsma 2013) does not fix it. We assemble three results and claim only the consequence of each. First, the squared effect size phi^2 admits no unbiased
estimator at any sample size: under fixed-N multinomial sampling the expectation of any
estimator is a
polynomial in the
cell probabilities, while phi^2 is not. Second, unbiasedness transfers across a rescaling of the effect size only if the rescaling is affine, and among affine choices V^2 = phi^2/k is the one bounded in [0,1] with value 1 at perfect association. Third, we give an interval with conservative, asymptotically valid coverage, obtained by projecting a likelihood-ratio confidence set for the
cell probabilities through the effect-size map; its lower endpoint is zero in closed form exactly when the test of independence fails to reject. Because nothing is unbiased, the only question is where the irreducible error is placed. Bergsma's correction puts zero error at the null but several percent under the alternative; a delete-one jackknife on the V^2 scale spreads it thin everywhere (absolute bias at most 0.008 over a 180-design grid). Pooling does not remove bias: across 3,000 simulated meta-analyses, pooling 200 studies drives the naive
estimator's chance of landing within 0.01 of the truth to zero, while the jackknife's rises to 0.99. The projected interval covers 0.997-1.000 across the tested designs, while a noncentral inversion undercovers (0.936 at phi^2 = 0.18) at two to three times the width. The point estimate and the interval are different problems with different answers; conflating them is why the literature has neither. We give a routing rule and a browser tool that implements it.
Read the full abstract ▾
Statistics Applications
Evaluating AlphaEarth Foundations Embeddings for Wildfire Susceptibility Mapping
Yuan Zhuang, Sanaa Hobeichi, Peng Shi et al. (+1 more)
Wildfire susceptibility mapping typically relies on physical variables assembled from multiple remote-sensing,
climate, and geospatial products. AlphaEarth Foundations (AEF) provides analysis-ready geospatial
embeddings that may reduce this dependence on heavy harmonisation and task-specific feature engineering, but their value for wildfire susceptibility mapping has not been systematically evaluated. Using Victoria, Australia (2017-2025), as a case study, we show that AEF
embeddings can reconstruct commonly used variables in wildfire susceptibility analysis with high accuracy. In downstream susceptibility models trained on satellite-derived fire occurrence data,
embedding-based susceptibility models achieve ROC-AUC values above 0.92 and consistently identify high wildfire susceptibility across eastern Victoria, particularly Gippsland and the north-eastern uplands, with additional localized hotspots in central and northwestern Victoria. A key feature of AEF
embeddings is their strong near-region transferability within climatically similar regions. When
embedding-based models trained in Victoria are applied to Canberra and Western Sydney-Blue Mountains, ROC-AUC improves by around 4% at Canberra and declines by around 2% at Western Sydney-Blue Mountains, compared with a mean decrease of approximately 25% for physical-variable models. These findings provide practical guidance for using AEF
embeddings and lay a foundation for scalable wildfire susceptibility mapping workflows for downstream users such as government agencies and (re)insurers.
Read the full abstract ▾
All authors Yuan Zhuang, Sanaa Hobeichi, Peng Shi, Fei Huang
Statistics Applications
Hierarchical Spline-Based Bayesian Beta-Binomial Regression for Estimating Time-Varying Risk in Power Outages
Justin Jacobs, Jesse Piburn and Aaron Myers
We propose a hierarchical
Bayesian model for estimating time-varying outage risk from county-level power outage data. The model combines cubic B-spline basis functions with a Beta-Binomial likelihood to capture smooth, nonlinear recovery trajectories while accommodating overdispersion in observed customer counts. A shared hyperprior on the Beta-Binomial concentration parameter enables hierarchical shrinkage across geographically indexed groups, allowing sparse or short-lived events to borrow statistical strength from the broader population. Posterior inference is conducted via the No-U-Turn Sampler (NUTS) in PyMC, yielding full posterior distributions over latent outage probabilities and derived resilience metrics including the area under the risk curve (AUC). We assess predictive performance using posterior predictive coverage, RMSE, and leave-one-out cross-validation, and demonstrate the model across a heterogeneous set of outage events in southern Wisconsin drawn from the EAGLE-I power outage monitoring platform. A direct comparison against naive trapezoidal AUC estimation confirms that the posterior mean recovers the same point estimates as deterministic integration while providing calibrated uncertainty quantification that deterministic approaches structurally cannot. The framework offers utilities and emergency planners a principled tool for benchmarking recovery dynamics and comparing outage events under uncertainty.
Read the full abstract ▾
Statistics Applications · Cross-listed from stat.ME
Bayesian Modeling of Gibbs Point Processes via Basis Function Expansions
Christopher Hassett, Athanasios C. Micheas, Scott H. Holan et al. (+1 more)
We present a hierarchical
Bayesian framework for non-homogeneous pairwise interaction Gibbs point process models, where the global and local effect functions are modeled via basis function expansions. We further propose a testing procedure in order to assess complete spatial randomness. The proposed methodology is exemplified through two real
benchmark data examples involving water striders and forest fires.
Read the full abstract ▾
All authors Christopher Hassett, Athanasios C. Micheas, Scott H. Holan, Stamatis Dostoglou
Statistics Applications · Cross-listed from stat.ME
Adaptable Fingerprinting with Nonlinear Shrinkage for Climate Change Detection and Attribution under Variance Heterogeneity
Haoran Li and Yan Li
Detection and attribution of
climate change relies on fingerprinting–a linear errors-in-variables regression framework in which both predictors and responses exhibit internal variability governed by a proportional covariance structure, subject to a variability inflation factor. Accurate estimation of the scaling factors (regression coefficients) depends on inferring the precision
matrix of the regression errors from limited
climate model control runs. In high-dimensional settings, existing approaches often overlook the variance inflation of the predictors and suffer from imprecise precision
matrix estimates, yielding biased
estimators, underestimated uncertainties, and confidence intervals with poor coverage. We propose a nonlinear, rotation-invariant shrinkage framework for estimating the precision
matrix that restores the asymptotic optimality of the total least squares
estimator in high-dimensional regimes. Our procedure jointly estimates the scaling factors and the variability inflation factor, thereby correcting estimation bias, and incorporates consistent variance
estimators to enable valid uncertainty quantification. We also develop a residual consistency test to assess model adequacy. Numerical studies demonstrate precise estimation, improved confidence interval coverage, and higher efficiency. Applied to annual mean near-surface air temperature data from 1951–2020, our method produces narrower and more reliable confidence intervals, yielding refined attribution results.
Read the full abstract ▾
Statistics Applications · Cross-listed from cs.LG
Which Site, and When: A Free-Satellite-Data Test of Himalayan Glacial Lake Bursts, Landslides, and Ice Floods
Matthew Kahn, Milan Arjel, Nirmala Adhikari et al. (+2 more)
Two free satellite signals carry real information about glacial-lake outburst risk in the Nepal Himalaya: radar interferometry sees a moraine dam slowly sagging, and satellite weather marks the weeks when a primed lake is under stress. A companion feasibility study found that deformation indicates which lake is destabilizing and weather indicates when it is at risk, but proposed no predictive model. To address this gap, we propose and evaluate models that predict which site is susceptible and when a trigger arrives. We test three related hazards on free data alone: large moraine- and ice-dammed bursts, rainfall-triggered landslides, and smaller floods from ponds on and around a glacier. Each hazard gets two questions, never blended. Using 589 dated outbursts from HMAGLOFDB and several thousand catalogued landslides, we match each event against similar but unfailed sites, and hold every model to a strong simple baseline under spatial cross-validation that withholds whole map tiles, so no model succeeds by recognising a trained-on neighbourhood. Antecedent weather times the trigger at ROC 0.73 for big bursts, 0.83 for landslides, and 0.82 for small floods. Terrain ranks susceptibility only in part: scored naively it appears near 0.9, largely because catalogued failures cluster in wetter ranges; matched against comparable nearby sites the honest figures are 0.76, 0.71, and 0.54 (no better than chance). The burst signal holds within single regions, reaching 0.89 in Nepal alone. Five deep-learning models do not decisively beat a simple gradient-boosted baseline. Three score marginally higher on landslides, a hint too small to confirm. For the lake hazards the baseline wins outright, reproduced by a three-rule decision tree on ruggedness and monsoon rainfall. We close with a ranked Nepal watchlist, a prioritisation aid, not a prediction, and note where free data reaches its limits.
Read the full abstract ▾
All authors Matthew Kahn, Milan Arjel, Nirmala Adhikari, Mingmar Sherpa, James Pope
Statistics Applications
Unequal urban capacities for mobility adaptation under fuel-price shocks
Zihao Zhang, Yuanbo Zhang, Xiaolei Ma et al. (+1 more)
What a city makes reachable depends less on what it contains than on who can still afford to move when travel costs rise. We leverage the 2026 US-Iran oil shock as a natural experiment, applying a hierarchical panel regression discontinuity design to 1.7 trillion point-of-interest visits across 122,000 neighbourhoods in China and the United States. Mobility range declined in nearly three-quarters of neighbourhoods, but responses varied systematically with pre-shock urban conditions. Exposure to energy-intensive travel explained the largest share of modelled heterogeneity in both countries, while adaptive capacity and activity composition further shaped how travel was reorganized. Longer baseline travel intensified contraction, whereas greater car dependence constrained adjustment. Crucially, similar mobility outcomes arose from different processes: some neighbourhoods maintained travel by absorbing higher costs, whereas others appeared structurally locked into travel they could not reorganize. Fuel-price shocks, therefore, act as urban stress tests, revealing which neighbourhoods a city keeps connected.
Read the full abstract ▾
All authors Zihao Zhang, Yuanbo Zhang, Xiaolei Ma, Yuan Liao
Statistics Applications · Cross-listed from stat.ME
Inverse Confounding Analysis: An Exact Method for Quantifying the Significance of Confounding
Sergey Porotsky
The presence of unmeasured confounding factors during the collection of observational data may lead to biased estimates of the effect of an exposure on an outcome. Consequently, a central problem in causal inference based on observational data is sensitivity analysis with respect to unmeasured confounding. Existing sensitivity analyses generally focus on worst-case bounds. We propose an exact method for quantifying the significance of confounding, defined here in terms of the complete range of analytical estimates of the stratification-based Risk Ratio over the set of all joint distributions compatible with the observed characteristics. We refer to the proposed method as Inverse Confounding Analysis (ICA). The proposed ICA method extends the widely used E-value approach but, in contrast to it, does not restrict the analysis to a worst-case lower bound. Instead, it provides exact estimates over the entire set of admissible configurations. This requires several additional input parameters, namely the frequencies of the exposure, the confounder, and the outcome. The ICA method is based on an inverse problem: reconstructing the set of admissible joint distributions from specified frequencies and pairwise associations. We formulate this reconstruction problem as a system of nonlinear equations and obtain an analytical solution. Surprisingly, the complete solution set can be parameterized linearly by a single free parameter. The corresponding stratification-based Risk Ratio is then represented as a fractional-linear function of this parameter. This representation makes it possible to derive exact analytical measures of the significance of confounding over the entire set of admissible statistical configurations.
Read the full abstract ▾
Statistics Applications
Urban logistics dynamics: a user-centric approach to traffic modelling and kinetic parameter analysis
Emilienne Lardy, Eric Ballot and Mariam Lafkihi
Efficient urban logistics requires a comprehensive understanding of traffic dynamics, particularly as it pertains to kinetic parameters influencing energy consumption and trip duration estimations. While real-time traffic information is increasingly accessible, current high-precision forecasting services embedded in route planning often function as opaque 'black boxes' for users. These services, typically relying on AI-processed counting data, fall short in accommodating open design parameters essential for management studies, notably within Supply Chain Management. This work revisits the modelling of traffic conditions in the context of city logistics, emphasizing its significance from the user's point of view, with two focuses. Firstly, the focus is not on the vehicle flow but on the vehicles themselves and the impact of the traffic conditions on their driving behaviour. This means opening the range of studied indicators, beyond vehicle speed, to describe extensively the kinetic and dynamic aspects of the driving behaviour. To achieve this, we leverage the Art.Kinema parameters designed to characterizing driving cycles. Secondly, this study examines how the driving context (i.e., exogenous factors to the traffic flow) determine the mentioned driving behaviour. Specifically, we explore how accurately the kinetic behaviour of a vehicle can be predicted based on a limited set of exogenous factors, such as time, day, road type, orientation, slope, and weather conditions? To answer this question, statistical analysis was conducted on real-world driving data, which include high-frequency measurements of vehicle speed. A Factor Analysis and a Generalized Linear Model have been established to link kinetic parameters with independent categorical contextual variables. The results include an assessment of the adjustment quality and of the robustness of the models, as well as an overview of the models' outputs.
Read the full abstract ▾
Statistics Applications
Auditing the Global Carbon Budget: Exploring the 2024–2025 Vintage Shift
Mikkel Bennedsen, Eric Hillebrand and Siem Jan Koopman
The Global Carbon Budget (GCB), the community reference
dataset for the carbon cycle, is reissued annually. The 2025 release introduces several adjustments to the published series that we compare with prior releases starting in 2017. On a common 1959-2016 sample, the mean of the GCB budget imbalance jumps from within +/-0.17 GtC/yr of zero for every vintage 2017-2024 to 0.61 GtC/yr in 2025, the only vintage whose 95% confidence interval for the imbalance mean excludes zero. The size of the imbalance changes much less: its mean absolute value rises from 0.61 to 0.76 GtC/yr. It is the mean, the quantity the budget identity constrains, that moves. We document and explore this shift in two ways. First, we conduct a model-free analysis, where we attribute the shift to a new adjustment that places the published land sink 0.40 GtC/yr below its ensemble mean (the average of the underlying models), a smaller adjustment in the ocean sink in the opposite direction, and a change in the composition of the bookkeeping ensemble. Second, we consider a dynamic statistical GCB model augmented with
climate covariates. Its parameters are estimated for every GCB vintage 2017-2025. The coefficients of atmospheric concentrations in the sink equations shift in opposite directions on the 2025 issue, mirroring the model-free findings. A constant in the budget equation, statistically unnecessary in every vintage from 2017-2024, is required in 2025 and is estimated at -0.59 (0.09) GtC/yr. There is a persistent drifting imbalance across the entire sample in the budget equation. Each of the three adjustments is documented in the 2025 release and rests on evidence about the component it corrects. Their joint effect is a budget that closes over the last ten years and carries a mean imbalance of 0.61 GtC/yr over the full record. We argue that this cost to the full sample outweighs the gain on the last ten years.
Read the full abstract ▾
Statistics Applications
Process-fracture mapping of a DLP-printed photopolymer using Bayesian active learning and surrogate-based sensitivity analysis
Ethan Blackwell, Yogesh C. Chandrashekar, Guoqiang Li et al. (+1 more)
Digital light processing (DLP) enables rapid fabrication of
polymer structures, but fracture performance depends on multiple interacting processing variables, making exhaustive experimental characterization impractical. This work presents a data-efficient framework for process-fracture mapping of a DLP-printed photopolymer using
Bayesian active learning and digital image correlation (DIC)-assisted Mode I fracture experiments. Four processing parameters were considered: layer angle, UV exposure time, layer height, and print temperature. Fracture resistance was quantified by the critical J-integral, $J_c$, obtained from three-point-bending tests with DIC-based evaluation of crack-mouth opening displacement and hinge-point kinematics. Beginning with two randomly selected conditions, Gaussian process regression (GPR) and a modified upper confidence bound (UCB)-style acquisition function selected 26 additional experiments, yielding 28 processing conditions with three replicates each. The final GPR surrogate reproduced the training data with $R^2=0.99$ and achieved leave-one-out cross-validation performance of $R^2=0.63$ and Pearson $r=0.81$. Surrogate-based sensitivity analysis quantified parameter effects and global contributions. One-at-a-time response curves revealed nonlinear conditional trends, while global Sobol analysis identified UV exposure time as the dominant processing variable, with first-order and total-order indices of 0.6780 and 0.7581, respectively. Based on total-order influence, the parameters ranked as UV exposure time, layer angle, print temperature, and layer height. The first-order Sobol indices summed to 0.8058, indicating non-negligible interaction and higher-order effects. These results demonstrate that
Bayesian-active-learning-guided experimentation can efficiently recover process-fracture relationships and parameter interactions from a sparse experimental campaign.
Read the full abstract ▾
All authors Ethan Blackwell, Yogesh C. Chandrashekar, Guoqiang Li, Kshitiz Upadhyay
Statistics Applications · Cross-listed from cs.LG
Certifying What Helps Customer-Return Timing: A Screen-and-Confirm Test for Conditioning Signals, and Why Decay Is Nearly Enough
Sang Su Lee, Vineeth Loganathan, Shishir Dash et al. (+1 more)
Practitioners enrich customer-return models with ever more signals (lifetime value, category, recency/frequency, calendar, geography), and the temporal-point-process (TPP) literature follows suit with
covariate- and external-
covariate-conditioned intensities. But does any of it improve the timing, and how would you know? A null ("feature X doesn't help") is only meaningful if the model could have found a signal. We make two contributions–a method and a measurement–to answer this credibly. (i) A screen-and-confirm protocol that certifies whether a candidate signal improves a TPP's event-timing likelihood: a positive control plants a coupling of known strength and confirms the model recovers it, so a real-data null can be read as "no signal" rather than "weak method." The control is validated for categorical and continuous encodings, and on a real clock-driven
dataset (NYC taxi hour-of-day). (ii) A model-free ceiling quantifying how little of customer-return timing is point-predictable at all (a single-digit percentage of gap variance from any
covariate; returns are near-memoryless). With these we certify a clean result on three public
benchmarks (Amazon, Taobao, RetailRocket) and a real marketplace (Thumbtack): the inter-event clock–continuous-time decay, long known to beat frozen-intensity models–is nearly sufficient, and the conditioning the field keeps adding is redundant or harmful on top of it (statistically null on the public
benchmarks, at most 0.06 NLL; null to mildly harmful on the marketplace). We do not claim to discover that decay helps; our contribution is the tools that turn "conditioning doesn't help" into a checkable, certified statement–plus an honest-evaluation account of the read-out/leakage pitfalls we hit and retracted.
Read the full abstract ▾
All authors Sang Su Lee, Vineeth Loganathan, Shishir Dash, Vijay Raghavan
Statistics Applications · Cross-listed from stat.ME
Analytically Corrected Bayesian Modularization for Local Item Calibration
Paul A. Jewsbury and Steven W. Nydick
The continuous calibration of pilot items embedded in operational assessments is challenging when pilot samples are small and adaptively routed. We formalize a
Bayesian modularization framework for local item calibration that blocks feedback from pilot responses to the operational latent scale: Plausible Values are drawn from the operational posterior, and each pilot item is calibrated by its own local logistic regression. This construction is computationally scalable, protects operational trait estimates from malfunctioning pilot items, and admits Firth's penalized likelihood for sparse routed samples. Because treating imputed traits as fixed predictors induces attenuation, we derive closed-form disattenuation mappings that recover the generating item parameters under normal-ogive, posterior-normality, homoscedasticity, and joint-normality approximations. The resulting Modular Local Calibration (MLC)
estimator reaches the target of marginal-likelihood calibration without per-item numerical integration. A multivariate delta-method covariance combined with Rubin's-rules pooling propagates operational item-parameter uncertainty into the focal item standard errors. Monte Carlo simulations for the unidimensional 2PL show that corrected MLC substantially reduces attenuation bias and yields nominal-to-conservative interval coverage in the studied conditions, including under restricted-range MAR routing.
Read the full abstract ▾