Statistics Applications · Cross-listed from cs.LG
Global tree forecasters collapse at the hierarchical aggregate: a five-panel failure characterization
Md Rezwanul Islam and Wael Mohammed
Global forecasting models pool many series and learn one shared function. Gradient-boosted trees are their most common form. We measure a failure of this design that has not, to our knowledge, been documented. Train a global tree on the individual series of a hierarchy, then ask it for the hierarchical aggregate. The aggregate sits far outside the model's training range, and the forecast collapses. The model under-predicts the total by 30-50x in our production deployment, and by up to 496x in a public M5 reconstruction. The mechanism is known: beyond its training range, a tree predicts a constant. It surfaces at the aggregate because the total dwarfs every training series. The cure is not new. Per-series scaling, the preprocessing step that Montero-Manso and Hyndman (2021) recommend, prevents the collapse. So do a weighted aggregate-level training row and seasonal differencing. Our contribution is the characterization. The collapse reproduces on five panels: a production business-to-business marketplace, a synthetic hierarchy, M5, Australian Tourism, and a public business-buyer panel. It holds on three tree libraries, is invariant across training seeds, and is statistically significant. Its onset is immediate and tracks a simple support bound: a scale gap of only 1.15x already costs a third of the total. No standard configuration change prevents it: pooling every hierarchy level into training fails at scale, and the one knob that fits linear models in the leaves softens it without curing it. Rolling the forecasts forward recursively separates the cures: the aggregate-row cure re-collapses, per-series scaling degrades but stays low, and only seasonal differencing keeps its one-step accuracy unchanged. We close with a three-step procedure for diagnosing and preventing the failure in deployed systems.
Read the full abstract ▾
Statistics Applications · Cross-listed from stat.ME
A Hybrid Spatial Statistical Learning Framework for Individualized Probability Estimation: Application to Multisite Autism Neuroimaging
Montserrat Fuentes and Veronica B. Patterson
Autism spectrum disorder is a heterogeneous neurodevelopmental condition whose functional
brain organization varies across individuals and imaging centers. Resting-state functional connectivity provides an opportunity to study this variation, but analysis is complicated by high dimensionality, strong dependence among connections, and substantial site heterogeneity. We introduce a Hybrid Spatial Statistical Learning Framework for individualized probability estimation in multisite autism neuroimaging. The framework combines edge-level connectivity, graph-based network organization, and participant characteristics as complementary representations of a common probability target. Fine-scale connectivity retains discriminatory information, while broader representations stabilize probability estimates under site shift. All preprocessing and model development are performed within complete site-held-out validation to assess transportability to unseen acquisition environments. Simulations show that the hybrid preserves the discrimination of the strongest edge model while improving probability accuracy as between-site heterogeneity increases. In 860 participants from 20 ABIDE sites, the hybrid retained ROC AUC while reducing Brier score and log loss. These results show that multiscale integration can improve the reliability and transportability of individualized probabilities from complex, spatially dependent biomedical data.
Read the full abstract ▾
Statistics Applications · Cross-listed from cs.LG
Predicting Early Functional Decline from Longitudinal Laboratory and Vital Sign Trajectories: A Large-Scale Study Using the All of Us Research Program
Rashmita Kudamala, Aravind V. Kuruvikkattil, Lalitha Pranathi Pulavarthy et al. (+1 more)
Functional decline in older adults is typically recognized only after falls or observable gait impairment, closing the window for prevention. We investigated whether temporal trajectories of routine biomarkers, already recorded but rarely analyzed longitudinally, can identify patients in the pre-clinical phase of mobility decline. Using the All of Us Research Program (N = 297,861; 11.1% cases), we derived trajectory features (slope, variability, delta, mean) for twelve biomarkers over a three-year pre-index window. LightGBM models incorporating trajectories significantly outperformed static laboratory summaries (AUROC 0.797 vs. 0.755; DeLong p < 0.001; AUPRC 0.380 vs. 0.304). A 1:1 age- and sex-matched analysis confirmed an independent trajectory signal (AUROC 0.727 vs. demographics-only 0.680). A horizon analysis demonstrated sustained prediction 3-12 months before decline onset (AUROC 0.768-0.740). Because the model uses only measurements already ordered in routine care, it supports passive, zero-burden EHR integration for early detection of pre-clinical functional decline.
Read the full abstract ▾
All authors Rashmita Kudamala, Aravind V. Kuruvikkattil, Lalitha Pranathi Pulavarthy, Saptarshi Purkayastha
Statistics Applications · Cross-listed from stat.ME
Outlier Impact: Detection by Consequences
Daniel Ting, Ilya Gorbachev and Sammy Shen
We introduce a novel outlier detection method that utilizes a concrete measure of the statistical impact of an outlier rather than a vague notion of "unusualness". This allows practitioners to only flag points that materially affect the inferences made from the data while also ensuring these points are anomalous. This is of particular interest in experimentation, where outliers affect the validity of the causal inferences. In particular, we consider a potential outlier's impact on the mean and the False Positive Rate (FPR) of a hypothesis test.
Read the full abstract ▾
Statistics Applications · Cross-listed from q-fin.RM
What Quantitative Risk Modellers Can Learn from Durkheim's Study of Suicide
Mahmood Alaghmandan
Emile Durkheim's Suicide: A Study in Sociology (1897) predates much of the statistical machinery that quantitative modellers now take for granted. Yet, working with sparse and imperfect observational data, Durkheim repeatedly arrives at practices that remain remarkably relevant to modern modelling. This paper revisits Suicide from the perspective of quantitative risk modelling, not for its substantive conclusions, but for the
reasoning by which Durkheim reached them. His approach illustrates how careful definition, common sense, logical investigation, scepticism toward convenient explanations, and close
attention to what the data can and cannot support—all of which must precede, and can often substitute for, statistical sophistication. The broader lesson is simple: good modelling begins not with technique, but with understanding the problem, interrogating the evidence, and
reasoning carefully about what it can actually tell us.
Read the full abstract ▾
Statistics Applications
Stochastics of News Article Propagation: Joint Modeling of Counts and Reliability Composition in Event-Driven News Cascades
Harry Wang, Ruthesh Thavamani and Sriyan Madugula
We study the news cascade triggered by a single high-impact event as a pair of coupled
stochastic processes: the daily article count $N(t)$ and the reliable-vs-unreliable composition $\pi_{\mathrm{pos}}(t)$. Using the 2017 Las Vegas shooting as a primary case study (CC-News + NewsGuard, 91 days, 2,702 articles), we fit and compare four counting-process models for $N(t)$ and four distributional models for $\pi_{\mathrm{pos}}(t)$ on a common likelihood scale. For counts, a hybrid Inhomogeneous-Poisson plus Hawkes model wins decisively on AIC, BIC, and log-likelihood, as the IHP accounts for the initial exogenous shock, while the Hawkes accounts for the subsequent self-excitation. A profile-likelihood sweep of the Hawkes decay rate collapses the optimal Hawkes kernel to an AR(1) one-step lag $\lambda(t)=\mu+nN(t-1)$. This Markovian structure on the counts directly motivates the Part-B reliability models: we treat the reliability label as a first-order Markov chain on a binary state space and test homogeneous, regime-switching, and mean-field parameterizations against a bivariate Hawkes baseline model using a shared conditional binomial likelihood. The results show that the bivariate Hawkes model and the non-homogeneous Markov models are nearly indistinguishable on fit, as they exhaust the signal and start fitting to the noise. A brief replication on the 2017 Hurricane Harvey data shows that the same methodology applies but produces different results due to Hurricane Harvey's gradual endogenous build-up.
Read the full abstract ▾
Statistics Applications
Matching Urban Flood Sensor Placement to Monitoring Objectives Using Bayesian Optimal Experimental Design
Chen Cheng, Vinh Ngoc Tran, Jiayuan Dong et al. (+5 more)
Flood-monitoring sensors are often placed according to coverage, access, or expected inundation. However, the value of a measurement depends on the prediction or decision it is intended to inform. Using tRIBS-Urban simulations and a neural-network surrogate of the August 2014 metropolitan Detroit flood, we examine how this learning target changes single-sensor placement. Across 2,576 candidate locations, we compare parameter-oriented optimal experimental design (PO-OED), which values expected information gain (EIG) about model parameters, with goal-oriented optimal experimental design (GO-OED), which values EIG about specified flood predictions. We also examine how parameter EIG evolves during the event, and illustrate that parameter learning translates unevenly into reductions in predictive uncertainty across locations and lead times. Under GO-OED, point-depth targets favor nearby locations, whereas regional-average and regional maximum-depth targets can favor nonlocal locations. Weighted multi-point objectives retain similar broad spatial patterns, although their computed max-EIG locations differ. Public geospatial data further provide illustrative feasibility and contextual classifications for deployment screening. These results show how monitoring objectives shape sensor placement in optimal experimental design, and motivates an objective-first workflow that defines the intended prediction and priorities, applies field-verified restrictions, and ranks locations by EIG.
Read the full abstract ▾
All authors Chen Cheng, Vinh Ngoc Tran, Jiayuan Dong, Sarah Whitaker, Shannon Bergt, John Ziker, Valeriy Y. Ivanov, Xun Huan
Statistics Applications
Statistical and Deep Learning Approaches for Predicting Degradation of Polymeric Materials in Photovoltaics
Yili Hong and Xiaohong Gu
Polymeric materials are widely used in photovoltaic (PV) systems, making it essential to understand their service life to ensure reliable PV performance. The primary failure mechanism of polymeric materials in PV systems is photodegradation caused by ultraviolet (UV) radiation. Degradation modeling provides a framework for predicting service life, with a key step being the development of predictive models for degradation paths. This paper presents statistical and machine learning approaches for predicting the outdoor degradation of polymeric components in PV systems. We describe the study design and data collection process for developing predictive models based on indoor laboratory testing data, which are then extended to outdoor field conditions with time-varying environmental variables, with prediction uncertainty quantified through simulation. Deep learning (DL) methods are also explored, and results are compared across modeling approaches. The parametric statistical model demonstrates good fit and predictive performance across
datasets and shows greater robustness by incorporating physical and chemical knowledge. The DL model provides flexibility in capturing complex
covariate relationships and often yields accurate predictions, though it is less robust across
datasets. The paper concludes with remarks on key findings and their implications for PV reliability.
Read the full abstract ▾
Statistics Applications
A Synthetic Benchmark Dataset with Endogenous Marketing Spend for Validating Marketing Mix Models
Niklas Heusch
Marketing Mix Models (MMMs) estimate the incremental sales effect of advertising from observational time series, yet they are rarely validated against ground truth, because ground truth is unobservable in real data. Synthetic data closes that gap in principle, but existing generators produce marketing spend exogenously - omitting the central difficulty of the estimation problem, since real budgets are planned around promotional calendars, seasons, and recent performance. This paper presents a parameterized generator, and a fixed reference instance, of a synthetic weekly retail
dataset (156 weeks, three media channels) in which spend arises from four documented coordination mechanisms - quarterly budget feedback, anticipatory spending ahead of a promotional calendar, scheduled TV bursts, and algorithmic performance chasing - on a demand baseline with seasonal, quality, price, and unobserved sentiment components. Spend translates into incremental sales through two transformations, carryover and diminishing returns, instantiated here as
geometric adstock and logistic saturation with known parameters; the true causal decomposition of every week's sales is recorded alongside the error-contaminated variables a practitioner would observe. Every mechanism is a parameter that can be varied or switched off, and a companion procedure simulates go-dark geo-experiments with exact treatment effects. The seeded generator and reference instance are publicly released with notebooks that reproduce every number in this paper.
Read the full abstract ▾
Statistics Applications
Structural Estimation of Marketing Mix Model Parameters from Geo-Experiments
Niklas Heusch
Marketing Mix Models (MMMs) are widely used for marketing measurement and budget allocation, but face fundamental identification challenges: due to endogenous marketing spend decisions, MMM estimation on observational time-series data cannot recover the true causal effects of marketing. On the other hand, geo-experiments provide causal identification through randomization, but it is not clear how to use them efficiently to calibrate marketing mix models. We propose a novel structural estimation approach that recovers the complete set of MMM parameters - adstock decay ($\alpha$), saturation ($\lambda$), and effectiveness ($\beta$) - directly from geo-experimental time-series. By differencing outcomes between treatment and control regions, our method eliminates observed and unobserved confounding factors while preserving the temporal variation that identifies each parameter. We demonstrate on synthetic data that this approach recovers the true ROAS and the response curve over the range of spending covered by the experiments, together with credible estimates of the underlying parameters. Our framework enables efficient pooling across multiple experiments and provides a principled foundation for MMM calibration that fully utilizes the information experiments contain.
Read the full abstract ▾
Statistics Applications · Cross-listed from stat.ME
Public Signals, Concealed Choices: Dynamic Measurement without Behavioral Identification
Rok Spruk
Members of collective institutions may leave public traces while their individual choices remain concealed. This paper separates a corpus-conditional public position from the behavioral rule linking that position to participation and secret choice. I measure the first with a dynamic ordinal state-space model and establish a likelihood-exclusion result for the second. If behavioral-link parameters enter only the distribution of an entirely unobserved outcome and are a priori independent of measurement parameters, public signals leave their posterior equal to their prior. Declared monotone mappings are therefore reported as sensitivity envelopes, not estimates or identified bounds. Cabinet-sized simulations compare dynamic measurement with a static ordinal model and transparent summaries, exposing gains from temporal pooling and failures under weak measurement or omitted dimensionality. The application reconstructs 41 pre-decision official-source records preceding a concealed Slovenian cabinet decision. Only six of 21 ministers have attributable signals. The model locates a small visible group but leaves the remainder prior-dominated. Event-dependence adjustments, coding perturbations, rolling prediction, and the subsequently disclosed record support the same conclusion. Uncertainty should track the public information environment rather than be converted into unsupported behavioral precision.
Read the full abstract ▾
Statistics Applications
Knowledge-guided Transfer Prediction In Underrepresented Populations: A GRU-D-Static Framework For Maternal And Neonatal Outcomes
Yipeng Wei, Zahra Hoodbhoy, Emily R. Smith et al. (+22 more)
Integrating summary-level scientific knowledge into neural network models provides a practical strategy for transferring prediction models trained on adequately sampled source cohorts to underrepresented target populations, where individual-level data in the target domain are often limited or unavailable. In this study, we propose transfer prediction strategies incorporating external summary-level scientific knowledge and illustrate its application on the PRISMA Maternal and Neonatal Health Study, training a neural network model on the source data to predict adverse outcomes in the target cohorts. Besides, we also extend the existing GRU-D framework by incorporating static feature
embeddings and
attention weights to jointly leverage temporal and static information for improved prediction. Our approach employs soft labels derived from summary-level statistics describing the target population to fine-tune GRU-D-Static models that are initially trained on the source populations. We evaluate six maternal and neonatal outcomes, including stillbirth, preterm birth, low birth weight, small vulnerable newborn, neonatal death, and maternal near miss. Across all tested scenarios, fine-tuning using soft labels from just basic
covariates substantially improved predictive performance compared with deep learning models trained on the source sample. Furthermore, the performance slightly improves more when additional
covariates were incorporated into the logistic regression model or when partial input features from the target population were available for fine-tuning. These findings demonstrate that integrating existing scientific knowledge in the literature through transfer prediction of source neural network models can enhance prediction performance in underrepresented target populations, reducing reliance on large-scale data collection and supporting risk prediction in global health.
Read the full abstract ▾
All authors Yipeng Wei, Zahra Hoodbhoy, Emily R. Smith, Fang Jin, Muhammad Imran Nisar, Muhammad Farrukh Qazi, Christopher Mores, Victor Akelo, Caleb Sagam, Florence Aweyo, Charlotte Tawiah, Veronica Agyemang, Kwaku Poku Asante, Sam Newton, Santosh Joseph Benjamin, Anne George Cherian, Devakumar Devadhas, James A, Margaret P. Kasaro, Augustine Tunga, Sarmila Mazumder, Neeraj Sharma, Wilbroad Mutale, Mae Bridget Spelke, Qing Pan
Statistics Applications
Calibration of clinical trial sample size based on design utility
Charu Gupta, Gabriel Innocenzi, Christina Yap et al. (+2 more)
Clinical trial design relies on both statistical and clinical considerations for pre-specification of potentially practice-changing target treatment effects. As larger trials tend to be associated with high power and modest minimal detectable benefit, trial sample size is typically calibrated with reference to relevant precedents to prevent overpowering. Albeit trial sponsors and regulators are accustomed to this practice, there is scope for simplification to enhance the robustness, transparency and cross-trial consistency of this aspect of the design process. To this end, a design utility index is proposed here as a formal basis for sample size calibration, balancing the increase in power at higher sample sizes against the corresponding reduction in the magnitude of minimum detectable treatment effects, without requiring additional statistical assumptions or bespoke software. Application of utility calibration to a broad range of designs demonstrates consistency with regulatory expectations for minimum power, particularly in confirmatory settings, and effective protection against overpowering and against overly aggressive interim analyses.
Read the full abstract ▾
All authors Charu Gupta, Gabriel Innocenzi, Christina Yap, Daniel Jackson, Fabio Rigat