Statistics Applications · Cross-listed from cs.CY
Diagnosing the Demographic Distributions of LLM-Based Synthetic Persona Data: Reference-Distribution Dependence and Post Hoc Adjustment
Eunjeong Song and Sehee Hong
We examine how strongly demographic-distribution diagnostics of LLM-based synthetic persona data depend on the official statistics chosen as the reference. We compared the sex $\times$ age-group $\times$ province joint distribution of the 1,000,000 Nemotron-Personas-Korea (NPK) records with Korean official statistics using total variation distance (TVD). Against the resident-registration population for April 2026, the time of use, the upper bound on the share discrepancy of any subgroup defined by the three variables was 1.81 percentage points, the margin of error of a survey with about 2,900 respondents. This value, however, depended on the reference date and population definition of the official statistics. The closest candidate examined, the 2024 census distribution for Korean nationals, gave 0.56 percentage points; no monthly resident-registration reference was closer. The reference distributions themselves also moved: between January 2025, when NPK's distance was smallest, and April 2026, the resident-registration distribution moved by more than twice that minimum distance, as did the census Korean-national distribution between 2024 and 2025. Raking reduced the range of the distance across reference months to about one fifth.
Cell poststratification was applicable because none of the 204
cells was empty, and neither scheme produced extreme weights. Demographic
alignment is necessary but not sufficient for response validity, and even this basic diagnostic depends on the choice of reference distribution. Providers should therefore disclose the source, reference date, population definition, and joint-
cell allocation procedure of the official statistics used for demographic attributes, and users should repeat the diagnosis and adjustment against statistics current at the time of use.
Read the full abstract ▾
Statistics Applications
Can statistical models capture Mamdani's success? Social choice, ranked-choice voting, and model fit, with an application to the 2025 New York City Democratic Primary
Michael Pearce, Erin R. Lipman, Christopher Adolph et al. (+1 more)
Ranked-choice voting is increasingly prevalent in elections. An extensive literature in social choice theory – the study of collective decision-making with the goal of making compromises among disparate opinions – considers theoretical and empirical properties of various election procedures. Recently, a sub-literature on rationalizability, led by social choice theorists and computer scientists, makes explicit connections between social choice rules and maximum likelihood estimation. This paper further illuminates connections between social choice and statistical summaries of data. We begin by studying rationalizability from a statistical perspective, expanding existing results to realistic voting contexts and deriving statistical details necessary for model estimation and assessment. We then apply our work to ranked-choice votes from the 2025 New York City Democratic mayoral primary election. We demonstrate how rationalizing models impose unrealistic distributional assumptions and thus exhibit poor fit to voting data. Additionally, we show that non-rationalizing models meaningfully elucidate heterogeneous voter preferences. Our work demonstrates the inability of rationalizing models to capture key features of distributions of preferences in political elections, depriving analysts of fundamental uses, such as inference, typically associated with statistical modeling. Conversely, we show that statistical modeling can capture nuanced voter preferences by paying careful
attention to plausible data-generating mechanisms.
Read the full abstract ▾
All authors Michael Pearce, Erin R. Lipman, Christopher Adolph, Elena A. Erosheva
Statistics Applications · Cross-listed from econ.EM
Accelerating the Adoption of Residential Solar Power Systems: Policy Analysis using a Dynamic Structural Model
Sebastián Souyris, Jason A. Duan, Anantaram Balakrishnan et al. (+1 more)
Problem definition: Solar electricity generation is a strategic component of energy portfolios designed to meet growing demand and reduce carbon emissions. Governments and municipalities encourage household photovoltaic (PV) adoption through upfront rebates and tax credits. Limited budgets require principled, data-driven policies that account for the drivers of adoption and the effects of incentives on adoption rates. Methodology/results: We develop a dynamic structural model of residential PV
diffusion based on adoption decisions by forward-looking households that weigh the economic trade-offs between installing now and later. Adoption depends on return on investment and influence from neighboring adopters. The model segments households by home value and urbanization level, incorporates unobserved heterogeneity, and captures spatiotemporal installation dynamics. We estimate the model using
Bayesian methods and detailed household-level data from Austin, Texas. In out-of-sample tests, it predicts installations more accurately than contemporary alternatives. We simulate counterfactual policies within the dynamic
equilibrium of PV
diffusion to evaluate rebate designs. The framework can also be adapted to study the adoption of other durable technologies. Managerial implications: A rebate offered for a limited period generates more adoption and emissions reductions than a prolonged, costlier program. This counterintuitive result arises from forward-looking behavior, neighbor influence, and accelerated adoption before the rebate expires. We also evaluate phased reductions and rebates differentiated by household segment. A two-step reduction outperforms multiple small reductions. Geographic differentiation improves policy performance, whereas differentiation by home value offers little advantage over a uniform rebate.
Read the full abstract ▾
All authors Sebastián Souyris, Jason A. Duan, Anantaram Balakrishnan, Varun Rai
Statistics Applications · Cross-listed from stat.ML
(Mis)Understanding Benign Overfitting in Equity Return Prediction
Hui Guo, Jiawei Huang, Runze Li et al. (+1 more)
Highly overparameterized models often predict well despite interpolating training data in complex domains, challenging the classical bias–variance tradeoff. We investigate whether this “benign overfitting” phenomenon extends to equity return prediction. Consistent with recent statistical theory, we document two key phenomena: first, a double descent pattern in the ridgeless model's prediction risk; and second, that while the optimal ridge model consistently outperforms its ridgeless counterpart, this performance gap becomes negligible at large parameter-to-observation ratios. Ultimately, however, both models fail to outperform a simple historical average. This empirical evidence aligns with our asymptotic results under the null hypothesis of zero slope coefficients, suggesting that standard equity predictors lack true forecasting power—even within highly flexible, nonlinear machine learning architectures. These findings reconcile modern and classical machine learning in asset pricing: in the absence of a true signal, they asymptotically collapse to the historical average
benchmark.
Read the full abstract ▾
All authors Hui Guo, Jiawei Huang, Runze Li, Yan Yu
Statistics Applications · Cross-listed from econ.GN
The Measurement Revolution? Credible Measurement and Inference in the Age of AI
Melissa Dell and Ashesh Rambachan
Artificial intelligence (AI) is transforming measurement in economics. AI models convert unstructured data, such as text and images, into structured variables at low cost, making previously prohibitive measurement feasible at scale. This shifts the bottleneck from finding any scalable measure of a phenomenon to choosing among many plausible ones, which may support different empirical conclusions. This review provides guidance for navigating that shift. We describe three stages at which AI enters the measurement pipeline—discovery, construct definition, and observation—and what each demands of researchers. We argue that credible inference with AI-generated variables requires appropriately designed validation: anchoring measurement to explicit criteria, rather than informal claims that a proxy is reasonable. We then examine how validation samples support valid inference even when AI predictions are arbitrarily biased, and what can be done when a random validation sample is unavailable.
Read the full abstract ▾
Statistics Applications · Cross-listed from stat.ME
Evaluating the effects of policy interventions subject to early adoption: A case study of prescription drug monitoring programs and opioid dispensing
Sarika Aggarwal, Brent A. Coull, Nima Hejazi et al. (+1 more)
Policies that require organizations to use new systems, such as prescription drug monitoring programs (PDMPs), are often implemented in phases, with an initial period of voluntary access followed by mandated compliance. This allows the policy intervention to be adopted before compliance is required (early adoption), causing outcomes to change before the mandate takes effect. When early adoption is present, the no-anticipation assumption underlying synthetic control methods (SCM) is violated, leading to biased policy effect estimates. We formalize early adoption in a potential outcomes framework for staggered policy implementation and decompose the total policy effect into early adoption and mandate components. We then propose a two-stage, early adoption-aware SCM procedure that first estimates early adoption effects using an interactive fixed effects model fit to pre-mandate data and then residualizes outcomes before applying SCM variants to estimate mandate and total policy effects. Simulations, including settings with correlation between early adoption and latent factors, show reduced bias and improved uncertainty quantification relative to conventional SCM
estimators. We apply the framework to state-level PDMP policies and per-capita opioid dispensing. After accounting for early adoption, estimates suggest reductions in opioid dispensing following PDMP availability and mandates; however, the estimates are imprecise and not statistically significant.
Read the full abstract ▾
All authors Sarika Aggarwal, Brent A. Coull, Nima Hejazi, Rachel C. Nethery
Statistics Applications
From Daily Fluctuations to Annual Hydrological Cycles: A Wavelet-Based Analysis of Nonstationary Seasonality in Senegal River Hydropower Inflows
Steeven B. Affognon, Babacar M. Ndiaye, Pierre Mendy et al. (+1 more)
This study presents a reproducible framework combining
Fourier and wavelet analysis to examine the seasonality of daily inflows at three sites on the Senegal River (Bafing Makana, Felou, Gouina), based on 65,631 daily observations spanning nearly 60 years (1961-2020). Using harmonic regression, Welch spectral analysis, stationary wavelet decomposition, Morlet continuous wavelet transforms, trend and change-point tests, and cross-wavelet coherence, the authors show that the annual cycle corresponds mainly to the D8 detail level (roughly 256-512 days), rather than a level-4 approximation. The Haar wavelet was selected as the best fit among four families tested. The D8 component accounts for 18.85-19.89% of total energy, while
Fourier harmonic models explain 73.3-78.7% of daily inflow variability. The average seasonal peak occurs in September (around days 252-254), and annual coherence across the three sites is exceptionally high (0.988-0.999), indicating a highly synchronized regional hydrological cycle. No robust monotonic trend was found in seasonality strength, amplitude, or peak timing. However, Pettitt tests detected a statistically significant shift in amplitude or mean inflow around 1971-1976, consistent with a regional regime transition, though confirming this would require independent rainfall and dam-operation data. The framework offers a transparent basis for generating inflow scenarios within MOSSHOOS-Plan4RES and is transferable to other data-scarce hydropower systems.
Read the full abstract ▾
All authors Steeven B. Affognon, Babacar M. Ndiaye, Pierre Mendy, Cheikh M. F. Kebe
Statistics Applications · Cross-listed from cs.AI
Modalities Should Talk to Each Other: Dual-Stream Multimodal Learning for Long-Horizon Influenza Forecasting
Seyed Mohammad Hossein Hashemi, Mohsen Hooshmand and Parvin Razzaghi
Forecasting long-range influenza-like illness (ILI) matters for public health readiness. Publicly available surveillance
datasets typically pair numeric epidemiological signals with textual information that is noisy, loosely structured, only indirectly related to near-term trends, and often lagged relative to the numeric signal. Fusing the two therefore requires careful design. We propose Dual-Stream
Attention (DSA), a
multimodal deep learning framework that forecasts 12-week-ahead ILI activity from a 36-week
multimodal history by letting the numerical and textual streams condition each other. Using the Time-MMD health-domain
dataset, DSA separately encodes the two modalities with a
Transformer-based numerical encoder and a domain-adapted headline encoder, then couples them through a bidirectional Cross-Modal
Attention (CMA) mechanism: the text (news headlines) conditions the interpretation of the numeric signal and vice versa. The CMA output then passes to a causal temporal model for forecasting. Evaluated across ten random seeds, DSA achieves a median test MSE of 0.416, versus 0.668, 0.607, and 0.851 for iTransformer, TaTS, and GPT4MTS, corresponding to mean-error reductions of 54.95%, 37.29%, and 67.23%, with paired Cohen's d of 0.555, 0.337, and 0.345, respectively, and ranks first in 100% of bootstrap draws. It also has substantially lower worst-window error than all baselines. On an external-geography
dataset, DSA again ranks first among nine evaluated baselines. Ablations show the advantage does not depend on text-encoder choice or
language-model fine-tuning, and that bidirectional
attention outperforms either direction alone. Finally, perturbation-based faithfulness analysis shows the learned CMA is functionally informative under targeted masking, with a stronger effect in the text-to-numerical direction.
Read the full abstract ▾
Statistics Applications · Cross-listed from math.MG
An Approach to Study the Structural Consistency of Triangle Badness Functions and Distance Metrics
Bowen Liu, Yizhou Wang and Lingqian Meng
Triangle-based measures, commonly referred to as badness functions, are widely employed to quantify the extent to which a distance
matrix deviates from an ideal
geometric configuration. Different formulations of these functions may capture distinct facets of local non-uniformity, and their behavior is often influenced by the underlying distance metric chosen for evaluation. In practical settings, although a canonical badness function may be conceptually preferred, factors such as computational cost, algorithmic constraints, or data-specific characteristics frequently necessitate the adoption of modified versions-for instance, approximate forms or alternatives defined under different distance metrics. This gives rise to a central question: to what degree do these variants retain the structural consistency properties of their original counterparts? To address this issue, we develop a systematic correlation-based framework for evaluating structural consistency. As an illustrative instantiation of this framework, we compute badness sequences from a set of representative distance
matrices alongside randomly generated triangle configurations, which are designed to cover variants that may arise under diverse practical scenarios. We then assess pairwise similarities among these sequences using four correlation coefficients. The experimental outcomes indicate that certain badness variants exhibit a notably high degree of structural consistency, whereas others reveal complementary behavioral patterns; moreover, the choice of distance metric exerts a considerable influence on the observed trends. These findings offer practical insights for the informed selection of distance metrics and triangle badness function variants in tasks including
geometric reconstruction, triangulation, and structural analysis of pairwise distance data.
Read the full abstract ▾
Statistics Applications · Cross-listed from stat.ME
Sequentially valid inference for probabilistic inflation forecasts
Amadeo Grob, Maurizio Daniele and Johanna Ziegel
Traditional statistical tests are poorly suited for the sequential evaluation of probabilistic forecast calibration. We address this limitation in macroeconomic forecasting by applying a new sequential testing method based on e-values. The e-value-based methodology enables anytime-valid inference. It allows practitioners to test against calibration continuously without invalidating statistical guarantees. To illustrate the framework's practical value, we apply it to probabilistic inflation forecasts for the United States, the Euro Area, and Switzerland. Our analysis shows that the sequential approach gives detailed insights into the timing and nature of forecast misspecification. We find these diagnostics are particularly insightful during major structural breaks. During these events, we find evidence against calibration that static, full-sample tests often miss. Therefore, this work shows that e-value-based tests are a practical method for the evaluation of forecast calibration in empirical macroeconomics.
Read the full abstract ▾
Statistics Applications · Cross-listed from q-bio.MN
Uncovering Cellular Resolution in scRNAseq via Unbiased Cell and Gene Network Analysis
Olga lanzetta, Luisa Cutillo, Bailey Andrew et al. (+1 more)
Conventional annotation of single-
cell RNA-sequencing (scRNA-seq) data relies heavily on manual, marker-based thresholding, an approach that can obscure subtle transcriptomic gradients and collapse functionally distinct
cell states into broad, heterogeneous populations. Here we apply the Gaussian multi-Graphical Model (GmGM) framework, which jointly infers
cell-
cell and gene-gene dependency structure from a single scRNA-seq data
matrix, to a 10x Genomics PBMC
dataset. Ten independent GMGM-Leiden clustering runs were integrated into a robust consensus partition using a soft cluster ensemble approach and benchmarked against reference
cell-type annotations. This strategy yielded stable cluster partitions that resolve biologically meaningful sub-populations not distinguished by the reference annotation. In parallel, for each cluster, gene co-expression modules were extracted from the fitted model via consensus Leiden clustering across resolutions, evaluated using standard network metrics, and validated functionally with the Network Enrichment Analysis Test (NEAT), which confirmed non-random enrichment signal. A module-scoring procedure linked network
topology to per-
cell, per-cluster expression signatures, and a novel extension of GmGM, recovering a shared
cell-
cell network together with population-specific gene networks in a single model run, was demonstrated in a case study on the CD4+ T-
cell population. These results indicate that GmGM provides a unified, reproducible framework for joint
cell clustering and gene-network inference, capable of revealing cellular structure beyond that captured by conventional pipelines.
Read the full abstract ▾
All authors Olga lanzetta, Luisa Cutillo, Bailey Andrew, Claudia Angelini
Statistics Applications · Cross-listed from stat.ME
Identification and Inference for Causal Effects in Extremes under General Conditions
Lisa Leimenstoll and Melanie Schienle
Understanding the propagation of extreme events is important in many economic and environmental applications, yet most econometric methods for causal inference focus on average effects rather than tail behavior. This paper studies the identification of causal relations in extremes and derives resulting
estimators and their asymptotic inference. As measure of causal dependence between extreme realizations of variables, we analyze the asymptotic behavior of the Causal Tail Coefficient (CTC) within a linear structural causal model with heavy-tailed regularly varying innovations. In contrast to the existing literature, we allow the variables in the system to exhibit heterogeneous tail indices and consider the presence of potentially heavy-tailed confounders. We derive theoretical results assessing the limiting behavior of the CTC under these conditions and show how differences in tail behavior can help to reach identification of the causal structure. Light-tailed confounders are asymptotically negligible, but sufficiently heavy-tailed confounders can induce extremal dependence patterns that are observationally indistinguishable from direct causal effects. When suitable proxy information is available, identification can be recovered using an adjusted Causal Tail Coefficient. Based on these results, we develop estimation and inference procedures for causal relations in extremes under general conditions. We establish asymptotic properties of the proposed
estimators and derive tests for the causal direction and heavy-tailed confounding. Simulation evidence examines their finite-sample performance and provides guidance on their implementation. Applications to
climate and financial extremes illustrate how the proposed methods can uncover causal relations that may remain undetected by approaches targeting average dependence.
Read the full abstract ▾
Statistics Applications
Data Shared Neighbourhood Selection for multi-condition network inference
Blanche Francheterre, Ruben Colindres Zuehlke, Vivian Viallon et al. (+2 more)
External stresses may affect both the circulating levels of specific biomarkers and disturb the correlation structures across molecular entities. The contribution of both types of dysregulations to the subsequent risk of disease are yet to be evaluated. We propose Data Shared Neighbourhood Selection (DSNS), a joint network inference method for estimating preserved and altered conditional association structures across related conditions. DSNS combines neighbourhood selection with the Data Shared Lasso decomposition, representing each nodewise regression coefficient as the sum of a shared component and a sparse condition-specific deviation. This provides an interpretable decomposition of molecular associations while retaining the computational advantages of neighbourhood selection. We also adapt the Stability Approach to Regularisation Selection (
StARS) to this two-parameter joint estimation setting. In simulations involving sparse, hub-based and rewiring perturbation mechanisms, DSNS matched the best joint estimation methods for two conditions and outperformed them as the number of conditions increased, while remaining substantially faster than graphical lasso frameworks. Applied to prediagnostic inflammatory proteomic data from future lung cancer cases and matched controls in the EPIC-Italy and NOWAC cohorts, DSNS highlighted altered associations involving CDCP1 and IL10, two established lung cancer risk markers, as well as differential associations involving
proteins not selected by risk models.
Read the full abstract ▾
All authors Blanche Francheterre, Ruben Colindres Zuehlke, Vivian Viallon, Marc Chadeau-Hyam, Julien Chiquet
Statistics Applications
Evaluating cross-encoders for semantic similarity assessment in psychological questionnaires
Isabella Kainz, Karin Labek and Roberto Viviani
Correlations between rating scales are commonly interpreted as evidence of convergent or discriminant validity, yet prior studies suggest that part of these associations may be attributable to semantic similarity between item wordings rather than to genuine construct overlap alone. Building on this evidence, largely derived from bi-encoders, the present study explores whether cross-encoders, which jointly encode item pairs, offer a suitable technique for detecting semantic overlapping between questionnaire items. Using response data from the NEO-FFI and the PID5BF+M (N = 502, Labek et al., 2024), we examined whether cross-encoder-derived semantic similarity estimates are associated with empirical item correlations, and whether cross-encoders offer a systematic advantage over bi-encoders. Across twelve cross-encoder models, semantic distance was consistently negatively associated with absolute item correlations, reaching statistical significance in two-thirds of the models, with R2 values of up to .37. However, cross-encoders did not consistently outperform bi-encoders based on the same base models. These findings extend prior evidence for semantic components in scale intercorrelations to cross-encoder architectures, while indicating that predictive value depends more on model-specific training characteristics than on encoder architecture itself.
Read the full abstract ▾
Statistics Applications · Cross-listed from stat.ME
An Anchored Logistic Family for Bounded Trait Measurement and Growth: Origin Before Unit
Jaehwa Choi
Latent trait models differ less in what they measure than in what they fix. Item response theory frees the trait from the items administered but, in doing so, surrenders the origin and unit of the scale to convention. The Cognitive Trait Model (CTM; Choi, 2022) restores both by bounding the trait on [0, 1], where 0 denotes an ignorance level and 1 a mastery level defined by the task domain. We generalize the derivation behind CTM into a family indexed by the mastery anchor $L$: the published model is the case $L = 1$, while the limit $L \to \infty$ gives a half-truncated link with an absolute origin but no ceiling. Origin before unit. Bounded support admits Gauss-Legendre quadrature without truncation error, so item and person parameters follow from Bayes modal EM rather than MCMC. On identical data and priors this reproduces the published estimates ($\theta$ correlation 0.9999) while running 35 times faster than a converged random-walk sampler and 73 times faster than NUTS; a single adaptive-testing update costs about five microseconds. Applied to the time axis, the same link becomes a four-parameter growth curve spanning accelerating, decelerating, plateauing and declining trajectories, though not non-monotone ones. The family reduces to a reparameterization of the logistic model only when all items share a slope, so a measurement advantage is possible in principle; three simulations find none, locating the contribution in interpretation and computation rather than in measurement itself. In the LSAT reanalysis, examinees with perfect scores read 67%, 75% or 100% of mastery depending on the
estimator – the criterion-referenced claim is meaningful only with its uncertainty attached, and the coordinate is not in general the proportion of the domain a person can perform.
Read the full abstract ▾