Machine Learning (Statistics)
Rollcast: Proper-Score Gated Rolling Anchors for Adaptive Probabilistic Time-Series Forecasting
Giancarlo Vercellino
Rollcast is a probabilistic forecasting method for univariate time series that combines a compact set of rolling statistical anchors rather than relying on a single global model. Rolling means, medians, extrema, regression endpoints, and
quantiles define candidate forecast locations and a representation of the current state. A state-dependent softmax gate learns anchor probabilities by minimizing negative log predictive density, while residual distributions retrieved from similar historical states provide local uncertainty. Recursive simulation propagates the resulting mixture over multiple forecast horizons. The method is evaluated in a Monte Carlo study covering eight data-generating processes, including autoregressive, random-walk, local-trend, threshold, regime-switching,
stochastic-
volatility, heavy-tailed, and variance-break dynamics. Across 2,000 independent fitted series, Rollcast is compared with the true conditional predictive distribution generated by an oracle simulator. Overall empirical coverage is 86.2% for nominal 90% intervals and 91.5% for nominal 95% intervals. Predictive intervals are on average 13.6% wider than the oracle at the 90% level, while CRPS is 14.4% higher than oracle CRPS. Performance is closest to the oracle under autoregressive, threshold,
stochastic-
volatility, heavy-tailed, and variance-break dynamics, while local trends and regime switching are more challenging. The results indicate that Rollcast can construct competitive probabilistic forecasts from simple, interpretable local summaries, while also identifying limitations in calibration and recursive uncertainty propagation.
Read the full abstract ▾
Statistical Methodology · Cross-listed from astro-ph.GA
A Spatio-Temporal Self-Propagating Log-Gaussian Cox-Hawkes Process for Star Formation Modelling
Qihan Zou
Stochastic self-propagating
star formation models describe galactic structure through local triggering and feedback but are commonly formulated using discrete spatial
cells and time steps. We extend the spatio-temporal log-Gaussian Cox-Hawkes framework to obtain the Spatio-Temporal Self-Propagating Log-Gaussian Cox-Hawkes Process, a continuous point process model for the locations and times of
star-forming events. The model combines spontaneous formation, correlated environmental effects, outwardly propagating excitation, local inhibition, differential rotation, and saturation. An observation layer transforms the conditional event intensity into idealised maps of instantaneous
star-forming arm emissivity and recent young stellar surface brightness. For the selected parameter setting, the displayed realisation exhibits transient flocculent spiral-like patterns without any deterministic spiral geometry being imposed. The Monte Carlo experiment finds similar event production with and without rotation, whereas the stationary-front case produces fewer events. The displayed maps further suggest that differential rotation contributes to the winding and spatial arrangement of activity. The proposed framework provides a basis for future statistical inference from spatially and temporally resolved observations of
star formation.
Read the full abstract ▾
Other Statistics
Statistical Theory in the Age of Machine-Assisted Mathematics: Rethinking How Theory Is Made and Taught
Pietro Coretto
The computational revolution is advancing at an unprecedented pace. The combination of proof-assistant technologies and generative AI tools has recently enabled the solution of complex problems in pure mathematics at a scale that seemed unattainable only a few years ago. However, these technologies have not yet become standard tools in the development of statistical theory. In this paper, we do not present new theoretical results. Instead, we discuss five case studies involving classical problems in statistics and describe how they can be analyzed using a machine proof-checking. Our goal is not to propose a definitive workflow, but to stimulate reflection on how these technologies may transform theoretical research and advanced statistical education. We focus on two main aspects. First, statistical theory often compresses substantial mathematical content into expressions such as "under the usual regularity conditions". Formalization in a machine-verifiable
language forces each assumption to be explicit, reveal hidden dependencies, and provide a deeper understanding of the formalized objects. Second, we argue that the statistical community could benefit from a collaborative effort to build repositories of formalized axioms, definitions, and
theorems, supporting more precise and reliable theoretical developments. Finally, we discuss the role of these tools in graduate education. Just as high-level programming
languages revolutionized empirical research by enabling rapid experimentation and prototyping, machine-assisted formalization may introduce a new paradigm for the development, verification, and communication of statistical theory.
Read the full abstract ▾
Statistics Applications
Quantifying Impacts of Wildfire Smoke on Crop Yields in California
Astrid N. Hoefler, Robert B. Lund and J. Elliott Campbell
Climate change and increasingly severe wildfires pose significant threats to both people and ecosystems, yet little research has focused on the impacts of wildfires on crops. In addition to direct effects such as health risks to agricultural workers and crop damage, there is evidence that smoke may affect crop productivity and quality. This study aims to analyze the effects of wildfire smoke on crop production in Northern California. We quantified the relationship of particulate matter on grape yields using statistical regression models with a wide range of different
climate and air quality predictor variables. Our analysis identifies an association between air quality deterioration due to wildfire smoke emissions and reduction in wine grape yields. For two of the three study sites, particulate matter emerged as a significant predictor variable in combination with temperature. Final models for Sonoma and Napa had R2 values of 0.79 and 0.66 respectively, suggesting a shift from
climate only-controlled yields to wildfire and
climate-controlled yields. This work sets the stage for the next generation of agronomic models that incorporate the growing threat of wildfire on agriculture production systems.
Read the full abstract ▾
Statistics Theory
Optimal Stratified Allocation for Rare-Event Onset Forecasting in Dependent Sequences
Jaskaran Singh
Let a finite population of n labelled examples carry a class-weighted loss, with pi*n in a rare positive class weighted by N0/N1. We study estimation of total risk from a subsample K << n under designs allocating K0 and K1 draws to the two strata. We derive the exact finite-population variance of the weighted risk
estimator under class-conditional sampling without replacement and solve for the optimal allocation. The class multiplier inflates positive-stratum dispersion by the imbalance ratio, causing that ratio to cancel from the optimal allocation and making equal, rather than proportional, allocation the natural default. Simple random sampling is dominated by an explicit between-stratum term; an exact bias identity shows that cluster-representative selection has no general unbiasedness guarantee; and a Serfling bound transfers the allocation result to selection error over a finite candidate set. Under the implemented truncation, the realised allocation ratio is gamma=min(2*pi/f,1), independent of n, yielding the parameter-free efficiency prediction A(pi,f)=gamma/[pi(1-pi)(1+gamma)^2]. A separate measurability result bounds the record occupied by a labelled example, determining the required train-test separation and controlling departure from block independence under absolute regularity. We test these predictions on forecasting the onset of statistically explosive price regimes, dated ex post by the Phillips-Shi-Yu procedure, using 350 U.S. equities from 2004-2011 with under 1% positive rows and five purged forward blocks. The predicted ordering of the four designs holds, and at the 10-day horizon the five design points are ordered exactly as predicted by A (Spearman rho=1, exact p=0.0167). The predicted dependence on pi across horizons does not hold; we identify the channels lying outside the design-based argument.
Read the full abstract ▾
Statistical Methodology
On tail-robust autocovariance matrix estimation for high-dimensional and potentially nonstationary time series
Haotian Xu, Stephane Guerrier, Runze Li et al. (+1 more)
In this paper, we study the autocovariance
matrix estimation and inference problems under heavy-tailedness, high-dimensionality, general nonlinear temporal dependence, and potentially nonstationarity of time series. We consider two types of tail-robust autocovariance
matrix estimation methods: the element-wise Huber's $M$-
estimator and a computationally more efficient element-wise truncated
estimator. Both
estimators are designed to achieve sharp error bounds in
matrix max-norm. The nonasymptotic properties of these
estimators are proved based on new variants of Bernstein-type inequalities under functional dependence for the potentially nonstationary processes which may be of independent interest. Moreover, we prove a high-dimensional Gaussian approximation result, as a limiting distribution, for our element-wise truncated autocovariance
estimator. A Gaussian multiplier bootstrap result is also given to facilitate the practicality. Our theoretical results are nonasymptotic, which gives explicit error bounds in terms of the sample size, dimensionality, moments, and the strength of temporal dependence. Numerical evidence is provided to support our theoretical results. Finally, we illustrate the benefits of the proposed methodology for detecting change points in monthly macroeconomic data.
Read the full abstract ▾
All authors Haotian Xu, Stephane Guerrier, Runze Li, Yuan Ke
Statistics Applications
One-Shot Screening of Simulated Systems for Acceptability
Jinbo Zhao and David J. Eckman
We introduce a general-purpose framework for designing screening procedures for problems featuring a finite set of simulated systems, a.k.a. ranking-and-selection problems. The framework offers a novel perspective on screening in which decisions to retain or eliminate systems are based on confidence regions for the unknown problem instance rather than comparisons of estimated performances. Specifically, a system is retained if it has acceptable performance under some plausible configuration of response vectors contained in the confidence region. This perspective facilitates the design of procedures that guarantee to return either all acceptable systems, or each acceptable system, with high probability and accommodates many well-studied definitions of acceptability, including feasibility with respect to
stochastic constraints and optimality with respect to one or more objectives. We further study a subclass of the framework that yields simple and computationally efficient screening procedures that often have lower-order time complexity than existing methods and naturally supports parallelization without loss of screening power. We demonstrate the effectiveness and efficiency of the procedures through numerical experiments.
Read the full abstract ▾
Statistics Theory · Cross-listed from cs.LG
On the Abundance of Critical Points of the t-SNE Energy
Nakul Haridas and Ryan Murray
This paper considers the energy landscape of the t-SNE
algorithm. While this
algorithm has enjoyed broad adoption, the non-convexity of the associated energy has made it difficult to rigorously understand what the
algorithm captures in many settings. In particular, a number of well-known numerical examples, several of which are reproduced in this article, suggest a complicated energy landscape with many local minimizers that do not respect the
topology or clustering structure of the underlying data. This work seeks to provide first steps towards a rigorous explanation of these phenomena. Specifically, for a general family of energies, which include both the original t-SNE
algorithm and recently identified large data limits, and for densities in feature space which obey a continuous
symmetry, we construct infinite families of distinct critical points. These critical points are based upon identifying pairs of discrete
symmetries, one in the original feature space and the other in the target
embedding space, which are preserved under gradient dynamics. These critical configurations exhibit many characteristics, such as
topology breaking and spurious clustering, which are often observed empirically. Finally, numerical and analytical examples are given throughout as a means of illustrating the approach.
Read the full abstract ▾
Machine Learning (Statistics) · Cross-listed from eess.SY
A Constraint-Aware Generative Framework for Synthetic Origin-Destination Demand in Logistics Networks
Leian Chen
Large-scale logistics networks require synthetic data generation capabilities to support scenario-based planning under novel conditions-such as network reconfiguration and demand shocks. Existing approaches, which rely primarily on historical observations, lack the ability to generate demand patterns that adapt to changes in network
topology while respecting operational constraints. We propose a constraint-aware conditional generative framework for synthetic origin-destination demand generation in hierarchical logistics networks. The framework models demand as a conditional distribution over destinations given each origin, enabling
topology-aware synthesis that is both topologically realistic and operationally feasible. Operational guidance is incorporated directly into the generative objective via differentiable constraints, while a flexible conditioning mechanism supports various operational contexts and adaptation to evolving network configurations. We instantiate the proposed framework based on a conditional generative model. Experimental validation on industrial real fulfillment and transportation network demonstrates 16% improvement over graph neural network baselines, 87% operational compliance, and efficient cold-start adaptation, enabling applications in capacity planning, network design evaluation, and routing optimization.
Read the full abstract ▾
Machine Learning (Statistics) · Cross-listed from q-bio.QM
Towards AI-Driven Nanomedicine Discovery: A Benchmark and Multimodal Learning Framework for Nano Self-Assembly Prediction
Quan Hao, Mengyue Fan, Zifan Dong et al. (+9 more)
Nano self-assembly organizes molecular components into bioactive nanoscale structures. Self-assembled nanoparticles (NAPs) derived from Chinese herbal formulas and applications such as anti-lung-cancer therapy demonstrate the substantial potential of self-assembly for nanomedicine discovery. Yet discovery still relies on costly wet-lab screening, while existing machine learning approaches lack standardized tasks, effective pairwise compatibility modeling, and public
benchmarks with unified evaluation. To address these limitations, we formalize NSA prediction as a binary classification task for predicting self-assembly between molecular pairs and then establish NSA-Bench, the first public
benchmark with curated molecular combinations, experimental conditions, self-assembly labels, and standardized evaluation protocols. We further develop NSA-Net, an interaction-aware
multimodal framework that integrates complementary molecular evidence from graph
topology, sequence semantics, and physicochemical descriptors to learn molecular-pair representations for self-assembly prediction. Extensive experiments on NSA-Bench show that NSA-Net achieves a ROC-AUC of $0.9470\pm0.0112$ (Small) and $0.9492\pm0.0062$ (Large). On the Small track, it surpasses the strongest machine-learning and graph-based baselines by 3.9 and 17.1 percentage points, respectively. Representation analyses reveal interpretable molecular characteristics associated with self-assembly prediction captured by the learned representations. Moreover, an NSA-
Agent case study further demonstrates how NSA-Net predictions can support formulation refinement through experimental-condition-aware
reasoning. Our code is available at https://github.com/developer-hq/NSA-Net.
Read the full abstract ▾
All authors Quan Hao, Mengyue Fan, Zifan Dong, Jianduo Zhao, Changhao Xiao, Shangqing Jiao, Hao Zhang, Yudong Wang, Fei Xia, Jigang Wang, Liguo Zhang, Chong Qiu
Statistics Theory · Cross-listed from quant-ph
Spurious quantum correlations
Shashaank Khanna, Matthew F. Pusey and Roger Colbeck
In his seminal paper, Bell [Physics Physique Fizika 1, 195 (1964)] considers the correlations that result from space-like separated measurements on a pair of entangled particles. He uses relativity theory to motivate the Bell causal structure, then shows the existence of
quantum correlations that cannot be explained classically within this causal structure. Classical explanations of such
quantum correlations are possible in alternative causal structures, for instance, those that allow superluminal causal influences, but, as shown in [New Journal of Physics 17 033002 (2015)], all such alternative explanations require fine tuning (causation without correlation). Here we discuss the existence of spurious
quantum correlations — correlations that look
quantum in one causal structure, but have a natural classical explanation in another. More precisely, there are causal structures that admit non-classical
quantum correlations, but for which the same correlations have a classical explanation in another causal structure without fine tuning. The realisation in the other causal structure can also be achieved without breaking any natural constraints on the causal structure that follow from relativity theory. However, similarly to non-classical
quantum correlations in the Bell causal structure, we find other causal structures with non-classical
quantum correlations that do not have a classical causal explanation in any alternative causal structure without fine tuning.
Read the full abstract ▾
Statistics Applications
Natural Disasters and the Nonprofit Sector
Mayleen Cortez-Rodriguez
When natural disasters strike, individuals, communities, and even entire countries can suffer. Researchers have studied the impacts of disasters on various factors of interest, from mental health, to poverty, to economic activity. However, the impact of disasters on the nonprofit sector is understudied despite the nonprofit sector's perhaps surprising role in local or national economies as well as its role in disaster response and recovery. Thus, we study the effect of natural disaster damage on different county-level nonprofit outcomes using a panel
dataset spanning 1991 to 2021 and causal inference methods tailored to panel data. Contrary to prior work, which found small but positive associations between disaster damage and nonprofit revenue or assets, we find no evidence of a causal effect.
Read the full abstract ▾
Statistical Computation
Fast Computation of Nested Cross-Validation for Penalized Regression
Shuyang Cao and Alex Stringer
Cross-validation is a resampling procedure that provides a point estimate of generalization error for any predictive model. Cross-validation is widely used for model selection and evaluation. Uncertainty in the cross-validation estimate is challenging to quantify, and estimation of its variance is known to require multiple runs of the entire resampling procedure. Nested cross-validation computes a prediction interval for the generalization error for a given model and training
dataset by resampling the entire cross-validation procedure but incurs extraordinary computational cost. We provide an efficient method for computing the nested cross-validation prediction interval using only a single model fit for some penalized regression models including ridge regression, spline smoothing, and some functional regression models. We characterize when our proposed method should be expected to out-perform resampling-based nested cross-validation in various scaling regimes as well as in finite samples. Experiments for functional principle components regression demonstrate non-trivial cases in which our proposed method improves run times substantially.
Read the full abstract ▾
Statistics Theory
Bernstein–von Mises theorems for Bayesian probabilistic numerics
Sascha Gaudlitz and Sven Wang
We study probabilistic numerical methods for solving nonlinear PDEs from a
Bayesian nonparametric perspective. Given noisy evaluations at random collocation points, we place a truncated Gaussian series prior on the unknown solution and establish contraction at the minimax nonparametric rate, up to a logarithmic factor. Our main results give Gaussian approximations of the posterior in positive-order Sobolev spaces and, under suitable conditions, in the uniform
topology. This contrasts with classical ill-posed inverse problems, where Bernstein–von Mises
theorems typically require substantially weaker
topologies. Here, the observation operator is differential rather than smoothing, and inversion of its linearisation gains regularity, making these strong-
topology results possible. The posterior may be centred at either the posterior mean or the posterior mode. We further prove that the Gaussian Laplace approximation is asymptotically equivalent to the true posterior at a $\sqrt{N}$-scale.
Read the full abstract ▾
Statistics Theory
One Probability, Two Roles: The Separation of Coherence and Frequency in Adaptive Regimes
Yonggang Lu
Probability plays two distinct roles in modern data-analytic practice: (i) as an internally coherent, filtration-relative
language for sequential forecasting and, together with a stated loss or utility, decision making; and (ii) as a foundation for empirical claims such as stabilization, calibration, and repeated-sampling validity. The first role is relative to an assessment law $\mathbb Q$, whereas the second is evaluated under a governing law $\mathbb P$ and a declared repetition regime. In classical settings the roles are often aligned by conditional correctness under $\mathbb P$ together with i.i.d.\ or other stable-law assumptions under a fixed design, or by exchangeability. In adaptive and AI-mediated settings they can diverge because forecasts operate within feedback loops while reliability is evaluated under a potentially different law and regime. We synthesize relevant results from prequential forecasting, calibration, martingale and game-theoretic validity, adaptive data analysis, conformal prediction, and long-context AI reliability into a formal account of role separation. The resulting Role Separation Principle distinguishes internal coherence from conditional-mean correctness under the evaluation law and from target-specific reference and stability conditions. Two separation results show that a proper coarsening of the limiting-frequency distribution need not identify the governing law, and that even conditionally correct forecasts under that law need not accompany stabilization. We then develop a unified stabilization framework spanning filtration-based, shift-based, policy–environment, and design-based regimes and operationalize it through a regime-conditional audit checklist. Applied illustrations clarify calibration claims, synthetic-data validity, and structural mismatches relevant to some high-confidence unsupported AI outputs.
Read the full abstract ▾
Statistical Methodology
Model-assisted estimation with a training subsample: a two-phase sampling approach with design-based variance estimation
María Eugenia Riaño
When a flexible prediction model is fitted on a training subsample drawn from a probability sample, the model-assisted
estimator actually reported arises from one realized partition, yet existing theory quantifies uncertainty only for partition-averaged, cross-fitted, or symmetrized versions of it. We represent the training subsample as a second phase of sampling and derive, exactly and for any
algorithm, a two-term variance decomposition and the variance family linking the single-partition
estimator to its Rao-Blackwellized average, whose design bias it shares. For
cell-mean rules under equal-probability designs the
estimator is, exactly, a convex combination of a poststratified plug-in at the training-sample size and the exactly unbiased single-split
estimator of Sanguiao Sande and Zhang, which locates its bias precisely. For tree-type predictors the second-phase variance is computable in closed form when the
cell structure is fixed or $s$-measurable, and in that regime, for
cell counts $H=o(n)$, its share of total variance grows with the number of
cells – a design-based mechanism distinct from residual shrinkage and consistent with the variance underestimation documented for flexible learners. We propose an analytic and a replication variance
estimator, neither altering the point estimate, and evaluate them by simulation under simple random and stratified designs, in the adaptive regime and in an $s$-measurable configuration in which the theory is exact: in the populations studied, budgeting the second phase recovers much of the coverage lost by ignoring it, and the residual shortfall is attributable to the bias of the point
estimator rather than to its variance.
Read the full abstract ▾
Statistics Applications · Cross-listed from cs.LG
A Location-Invariant Estimator of Extremal Quantile Treatment Effects for Heavy-Tailed Distributions
Xin Yu, Shuwei Huang, Jicheng Liu et al. (+4 more)
Quantile treatment effects (QTEs) measure the effect of a treatment on the distribution of an outcome, and their estimation at extreme
quantile levels is of central interest in applications where the target
quantiles lie far beyond the range of the data. For heavy-tailed potential outcomes, existing extremal QTE
estimators rely on extrapolation combined with a causal extreme value index (EVI)
estimator, but the resulting
estimator is not invariant under a common location shift of the potential outcome distributions, even though the population QTE is. We address this issue in two steps. First, we adapt the location-invariant Fraga
estimator of the EVI to the causal setting using inverse propensity score weighting. Second, we replace the original extrapolation formula with a difference-based scheme, under which the location parameter cancels when
quantile differences are taken. The resulting QTE
estimator is therefore location invariant. We establish the consistency and asymptotic normality of the proposed extremal QTE
estimators, and provide a consistent variance
estimator, leading to asymptotically valid inference. A simulation study confirms the location invariance, the stability with respect to the threshold, and the coverage of the proposed methods.
Read the full abstract ▾
All authors Xin Yu, Shuwei Huang, Jicheng Liu, Jielin Tang, Bolin Wang, Yunxiao Zhang, Tian Zhao
Statistics Theory · Cross-listed from q-bio.NC
High-Order Triadic Functional Connectivity in the Brain and Beyond
Qiang Li, Masoud Seraji, Yu-Ping Wang et al. (+2 more)
Here, we report high-order functional network connectivity as a promising way for studying the
brain connectome. Traditional functional connectivity approaches capture only pairwise relationships between
brain regions, overlooking complex multivariate dependencies that underlie cognition and behavior. First, we demonstrated that high-order interactions capture more information and can distinguish between resting-state and task-state
brain activity. Second, we introduce a
matrix-based
entropy-functional method for estimating triadic interactions, which are statistical dependencies among triplets of
brain regions, and apply it to large-scale functional
brain networks. The resulting triadic networks revealed distinct community patterns that complement those observed in traditional pairwise functional connectivity analyses and simultaneously capture additional connection information. Despite the potential combinatorial explosion of triadic configurations, the networks exhibited constrained and hierarchical structures that allowed computation and interpretation. These findings position triadic connectivity as a promising next-step functional connectivity framework for probing
brain network organization and high-order neural interactions, while also highlighting key biological and technical challenges that require careful consideration.
Read the full abstract ▾
All authors Qiang Li, Masoud Seraji, Yu-Ping Wang, Godfrey D Pearlson, Vince D Calhoun
Machine Learning (Statistics) · Cross-listed from eess.SP
Cooperative Multi-Task Semantic Communication for Joint Classification and Regression Tasks
Ahmad Halimi Razlighi, Mohammad Siddiqur Rahman, Maximilian H. V. Tillmann et al. (+2 more)
Multi-Task semantic communication (SemCom) prioritizes simultaneous execution of multiple tasks over bit-accurate reconstruction in future intelligent networks. In our prior work [1], we introduced the cooperative multi-task SemCom (CMT-SemCom) framework, in which the semantic encoder is divided into a common unit (CU) and multiple specific units (SUs) to facilitate cooperative multi-task processing. However, CMT-SemCom has been evaluated on homogeneous classification tasks on simplistic
datasets, limiting its applicability to real-world perception systems. In this paper, we extend our CMT-SemCom to jointly handle heterogeneous classification and regression tasks on the complex Cityscapes
dataset. We adopt the information maximization (InfoMax) principle so that it accommodates mixed discrete and continuous semantic variables. In particular, we
benchmark the proposed framework against independent single-task training, a conventional task-agnostic digital transmission, and single-encoder multi-decoder SemCom. Additionally, we investigate the impact of CU capacity on joint task performance, providing design insights. Extensive evaluations demonstrate that CMT-SemCom significantly outperforms the
benchmarks.
Read the full abstract ▾
All authors Ahmad Halimi Razlighi, Mohammad Siddiqur Rahman, Maximilian H. V. Tillmann, Edgar Beck, Armin Dekorsy
Statistical Methodology
Causal Inference for Heterogeneous Extreme Quantiles with Heavy-Tailed Outcomes
Xiaorui Wang, Juan-Juan Cai, Huixia Judy Wang et al. (+2 more)
We propose a framework for estimating conditional extreme
quantile treatment effects (CEQTEs) in observational studies with heavy-tailed outcomes. Our procedure first estimates intermediate conditional
quantiles using inverse-probability-weighted (IPW)
quantile regression and then extrapolates them to extreme levels using extreme value theory. Under a linear conditional
quantile model, we show that the conditional and marginal distributions of each potential outcome share a common extreme value index (EVI), motivating two complementary Hill-type EVI
estimators based on conditional and marginal information, respectively. On the theoretical front, we introduce an IPW tail
quantile score process that bridges regression
quantile score processes and uniform tail empirical processes while accounting for treatment assignment. We establish its functional weak convergence under mild regularity conditions, without requiring a max-domain-of-attraction condition. This result provides the probabilistic foundation for the asymptotic analysis of the proposed CEQTE
estimators. Simulation studies demonstrate favorable finite-sample performance, and an application to NLSY79 data reveals substantial heterogeneity in the effect of college education on extremely high hourly wages across confounder-defined subpopulations.
Read the full abstract ▾
All authors Xiaorui Wang, Juan-Juan Cai, Huixia Judy Wang, Jian Qing Shi, Yanlin Tang
Machine Learning (Statistics) · Cross-listed from cs.LG
High-Dimensional Learning Dynamics of Attention-Indexed Models
Yizhou Xu, Margarita Sagitova, Lenka Zdeborová et al. (+1 more)
Attention mechanisms are central to modern foundation models, yet their training dynamics remain poorly understood, especially when the
attention matrices have extensive rank. In this work, we study
attention-indexed models, a broad framework that can represent multi-layer and multi-head
attention architectures. First, we show that, in a suitable high-dimensional limit, the population-loss landscape is characterized by a finite set of trace order parameters. In contrast, online
stochastic gradient descent (SGD) is governed by an infinite hierarchy of
matrix moments, which we show can be exponentially well-approximated by a finite truncated system. Second, this framework reveals that
attention parameterization itself can act as an architectural implicit bias. Direct optimization of an
attention matrix $S\in\mathbb{R}^{d\times d}$ can remain trapped in an uninformative state. Tied
attention ($S=WW^\top$) induces an automatic
symmetry-breaking mechanism and yields weak recovery in $\Theta(d^2\log d)$ samples. For untied
attention, $S=UV^\top$, we uncover a fast-slow mechanism: the pre-activation mean first evolves on a fast timescale, while the overlaps evolve on a slower one. Weak recovery on the $\Theta(d^2\log d)$ scale occurs when the state selected by the fast dynamics breaks the initial
symmetry.
Read the full abstract ▾
All authors Yizhou Xu, Margarita Sagitova, Lenka Zdeborová, Florent Krzakala
Statistical Methodology
Comment on: "The Two Cultures of Prevalence Mapping: Small Area Estimation and Model-Based Geostatistics"
Emanuele Giorgi, Claudio Fronterre and Peter Diggle
Small Area Estimation (SAE) and Model-Based Geostatistics (MBG) provide complementary approaches to prevalence mapping, with their relative advantages depending on the inferential goals and characteristics of the available data. We argue that a fuller comparison should consider model interpretability, the role of epidemiologically motivated
covariates, inferential objectives beyond area-level prediction, integration of data from different spatial partitions and surveys, and task-specific model validation. In particular, we question whether survey design variables should routinely be included in MBG models when their effects may instead be mediated by measurable environmental and socio-economic risk factors. We further argue that simulation-based validation, tailored to the operational objectives of prevalence mapping, can provide a more informative assessment of model performance than conventional cross-validation alone.
Read the full abstract ▾
Machine Learning (Statistics) · Cross-listed from quant-ph
Q-Edge: Symmetry-Reduced Quantum Simulation of Structured Extreme Dependence
Hongrui Zhang, Paolo Recchia, Jianlong Lu et al. (+1 more)
High-dimensional simulation of multivariate extremes is fundamentally limited by the combinatorial complexity of dependence, often more than by the scarcity of extreme observations. We show that
symmetry admits a lossless orbit-space representation that preserves structured extreme dependence while replacing an exponentially large dependence space with a compact set of
symmetry classes. Based on this principle, we develop Q-Edge (
Quantum Extreme Dependence Engine), a
symmetry-reduced
quantum framework that operates directly in orbit space, enabling scalable simulation and digital twins of structured extreme systems. By transferring
symmetry into the data representation rather than the
quantum circuit, Q-Edge allows unconstrained
quantum generative models to exploit dramatically reduced state spaces. For a 30-dimensional problem, approximately 1.6 million angular states collapse to 256 orbit states, reducing the required
quantum representation from about 21
qubits to 8. Our results establish a general computational principle for scalable
quantum simulation of structured extreme dependence.
Read the full abstract ▾
All authors Hongrui Zhang, Paolo Recchia, Jianlong Lu, Ying Chen
Statistics Theory
Symmetries and Causality: Causal Effect Identification Beyond IID Data
Martin Rabel and Jakob Runge
In the natural sciences,
symmetries and cause-effect relationships are ubiquitous. Yet for complex machine-learning tasks, like world-modeling in reinforcement learning, they appear difficult to harness. We propose a formal description of statistical systems based on
symmetries in data leaving causal mechanisms invariant. The result is an abstract, simple and general mathematical
language for causal
reasoning. This paper provides formal descriptions of models and queries, setting up this
language, and the formal infrastructure and strategies for their mathematically rigorous identification from data within this formalism. This approach reproduces and matches standard theoretical results on IID data and transport of experimental and non-experimental data. But its main purpose is to unify and substantially extend the scope of causal
reasoning, in going beyond IID data and in approaching complex causal queries not captured by do- or soft-interventions. This new perspective on causally relevant aspects of data-modeling additionally sheds new light on well-known structures like c-components or hedges but also includes aspects of missing data and is inherently well-suited for the description of transfer and robustness properties.
Read the full abstract ▾
Statistical Methodology
Parametric estimation of Hawkes processes based on ordinary least squares
Benjamin Poignard and Yoann Potiron
We develop a parametric estimation framework for self-exciting Hawkes processes whose intensity functions admit a parametric form. The estimation procedure is based on ordinary least squares. To apply the least squares estimation, we restrict to a kernel class that can be expressed as a sum of the product of a parameter and a function. We first establish the central limit
theorem for the proposed
estimator. We then show the consistency of the asymptotic variance
estimator. Finally, we introduce a Wald test statistic and derive its asymptotic distribution. We apply the proposed methodology to trade times from high-frequency financial asset data. Our empirical results provide evidence for three heterogeneous trader types. In particular, we identify two trader types as high-frequency traders and one trader type as fundamental trader.
Read the full abstract ▾
Statistical Methodology
Change-point analysis: a new perspective for unstable financial markets
Žikica Lukić and Bojana Milošević
We introduce two new classes of nonparametric change-point tests for sequences of univariate non-negative random variables. The proposed procedures are based on the empirical modified Hankel transform and the Laplace transform, respectively, and provide new transform-based tools for detecting distributional changes. We derive the asymptotic null distributions of the corresponding test statistics and use a permutation bootstrap procedure to obtain $p$-values, since the limiting null distributions are not distribution-free. Through a finite-sample simulation study, we show that the proposed tests are well calibrated, generally more powerful than empirical-characteristic-function-based competitors, and capable of accurately estimating the change-point location, particularly in asymmetric settings. The usefulness of the proposed methodology is further demonstrated through applications to Argentina rainfall data, as well as U.S. GNP and S&P 500 absolute log-returns. The real-data examples illustrate that the proposed Hankel- and Laplace-transform-based tests are effective tools for detecting meaningful distributional changes in non-negative data.
Read the full abstract ▾
Machine Learning (Statistics) · Cross-listed from math.PR
Correlated initialization of deep residual networks
Felix Benning, Ivan Nourdin and Giovanni Peccati
We study the large-depth behavior of residual networks whose weights are correlated across layers at initialization. Our results confirm and extend a
conjecture of Marion et al. [2025], according to which correlated initializations should interpolate continuously between the Brownian
stochastic differential equation arising from independent initialization and the ordinary differential equation arising from perfectly correlated initialization. When the initialization is obtained from the application of a feature function to a stationary Gaussian sequence with regularly varying correlation, we prove that there exists a unique critical scaling such that the infinite-depth limit is the solution of a Young differential equation driven by a Hermite process. Hermite processes reduce to the fractional Brownian motion if the feature function generating the initialization has Hermite rank one, which is the case for the identity function, for example. We show that the critical scaling and asymptotic limit are uniquely determined by the decay of correlations together with the Hermite rank of the feature function. Consequently, the correlation structure and Hermite rank of the initialization represent meaningful hyperparameters in the asymptotic regime. By contrast, under finite-variance iid initialization, the asymptotic driver is universally Brownian up to normalization regardless of the choice of distribution. Our proofs rely on a collection of novel results establishing a robust stability theory for Young differential equations in Banach spaces.
Read the full abstract ▾
Statistical Methodology
Random mixtures in Bayes Hilbert spaces
Giulia Patanè, Sonja Greven and Alessandra Menafoglio
We present a framework for the analysis and unmixing of random density mixtures in the Bayes
Hilbert space. General identifiability results for mixtures in
Hilbert spaces are established and applied to the Bayes
Hilbert space setting. Building on these results, we propose a penalised maximum likelihood approach for the unmixing of Bayes
Hilbert mixtures aimed at recovering the statistically space-efficient representation, together with a computationally efficient coordinate-wise maximisation
algorithm for its implementation. The methodology is illustrated through a hyperspectral data application, where observations can be naturally embedded in the Bayes
Hilbert space and analyzed in terms of distributional shape rather than amplitude. A complementary simulation study demonstrates the interpretability and practical performance of the proposed approach.
Read the full abstract ▾
Machine Learning (Statistics)
Towards a Statistical Understanding of Mixture-of-Experts
Siyuan He, Bokai Yang, Jie Hu et al. (+2 more)
Mixture-of-experts (MoE) architectures increase model capacity by combining a collection of expert predictors through input-dependent routing, while often activating only a small subset of experts for each input. Despite their growing importance in modern large-scale models, the statistical roles of their design choices, especially routing, sparse activation, and shared experts, remain only partially understood, as existing theory has largely focused on parametric or correctly specified MoE models. In this paper, we view MoE as a form of localized aggregation and show how this localization reshapes the approximation-estimation-computation tradeoff. We derive oracle risk bounds for learning dense and sparse routing with evolving experts, separating approximation, expert-learning, and router-estimation errors, and characterize how sparse Top-K routing can retain the benefits of localized aggregation while controlling per-input computation. We also interpret gating through the geometry of input space, relating routing performance to regions of local expert advantage, and show how shared experts, as adopted in architectures such as DeepSeekMoE, can extract common predictive structure so that routed experts focus on residual local variation. Together, these results provide a unified statistical framework for understanding MoE through input-dependent expert aggregation, in which expert specialization and computational tradeoffs are governed by local predictive structure.
Read the full abstract ▾
All authors Siyuan He, Bokai Yang, Jie Hu, Ziwen Gao, Yuhong Yang
Machine Learning (Statistics) · Cross-listed from cs.LG
Spectral characteristics of autoencoder parameters as a vector representation of data
Maria Nikitina, Anton Bishuk and Oleg Bakhteev
This paper examines the relationship between the parameters of autoencoder models and the statistical properties of the data on which they are trained. Autoencoders are defined as models with an encoder-decoder architecture, trained to reconstruct input data through a compressed latent representation. It is proposed that the model parameters can be viewed as a dense vector representation of the corresponding sample. To test this hypothesis, a theoretical and experimental study is conducted in which a vector representation is formed based on the spectral characteristics of the autoencoder parameter
matrices. Theoretical analysis shows that the singular values of the model parameter
matrices are related to the
eigenvalues of the covariance
matrix of the training data, ensuring the transfer of information between the data space and the parameter space. Experimental results on the CIFAR-10 and FashionMNIST
datasets confirm that the resulting vector representations allow for a high degree of accuracy in distinguishing between models trained on different data subsets, without resorting to complex vector generation
algorithms or using the original samples. These results suggest that the parameters of trained autoencoders can be viewed as sample representations.
Read the full abstract ▾