Statistics Theory
Comparing the reliability of coherent systems with heterogeneous, dependent and distribution-free components
Nuria Torrado
In recent years, there has been a growing interest in comparing the reliability of systems with dependent components. Most of the recent works consider Archimedean copulas to define the dependency structure of systems and examine specific familiy of distributions. In this work, we provide distribution-free results to compare, in the usual
stochastic order under some majorization conditions, coherent systems with heterogeneous and dependent components where the dependency structure can be defined by any copula. Applications of our main results for specific copulas and different families of marginal distributions are also given.
Read the full abstract ▾
Statistics Applications · Cross-listed from econ.EM
Distributional Difference-in-Differences: Aggregation Before or After Quantile Inversion?
Ulrich Hounyo
Staggered distributional difference-in-differences produces cohort-specific potential-outcome distributions, but applied work typically wants one overall
quantile treatment effect. Two natural summaries—averaging cohort
quantile treatment effects (QTTs) and mixing cohort distributions before inversion—use the same policy weights yet answer different target-population questions and can disagree even in sign. We derive the exact sharp interval for their gap conditional on cohort
quantiles and weights, a globally sharp range-only envelope, and a locally sharp density-tilt representation. We develop joint smooth and mass-point-safe inference and show that neither
estimator is uniformly more precise, even when the estimands coincide. In a same-object reconstruction of a public staggered-QTT application, holding data, identification, distributions, and weights fixed while changing only aggregation order reverses reported signs at several
quantiles. Aggregation order is therefore part of the estimand and must be chosen before inversion.
Read the full abstract ▾
Statistical Methodology
Dirichlet Process Mixtures of Trees with Gaussian Process Splits: A Bayesian Nonparametric Framework with Posterior Contraction Rate
Subhasish Basak, Anik Roy and Sourabh Bhattacharya
We propose a
Bayesian nonparametric mixture of regression trees with a Dirichlet process prior over tree-parameter pairs, enabling data-driven selection of ensemble size and unifying CART, BART, random forests, and boosting. A novel splitting rule driven by the posterior predictive of a Gaussian process within each terminal node generates flexible, smooth decision boundaries; remarkably, the GP density cancels exactly in the Metropolis–Hastings ratio for GROW/PRUNE moves, ensuring computational feasibility. An exact Gibbs sampler for posterior predictive inference propagates uncertainty through random tree traversal. A parallel MPI implementation distributes independent tree updates across processors, achieving adequate speedups. We prove posterior consistency at rate $n^{-1/4}$ in Hellinger distance under only continuity of the true regression function, allowing misspecification, via the identity $h(\Theta)=0$. Simulations on Friedman
benchmark show near-nominal coverage (0.94 Gaussian, 0.92 Cauchy), robust to high-dimensional noise and heavy tails, outperforming BART and bagged CART. Applications to QSAR toxicity, crime, riboflavin, wheat genomics, and air quality confirm reliable credible intervals and automatic sparsity. The DP mixture offers a principled, robust, theoretically justified alternative for challenging regression with honest uncertainty quantification.
Read the full abstract ▾
Statistical Computation
A Prediction–Correction Analysis of Two-Way Block Splitting in Distributed Learning
Xiaofei Wu
This note revisits the convergence of the Parikh–Boyd two-way block-splitting
algorithm for large-scale distributed learning through the He–Yuan prediction–correction framework. Simultaneous row–column partitioning is also relevant to hybrid
federated learning, where data may be heterogeneous in both samples and features. We lift the reduced iteration to an equal-dimensional product space and reconstruct the primal and dual coordinates omitted by its implementation. The induced orthogonal-complement structure establishes exact iteration-by-iteration equivalence with the published updates. A mixed variational-inequality representation then yields a fundamental descent inequality, global convergence, an ergodic complexity bound, and current-iterate residual estimates under standard convexity, solvability, exact-subproblem, and invariant-initialization assumptions. The analysis also shows that the reduced state recursion is a metric proximal point iteration. No strong convexity, differentiability, or full-rank condition is imposed. The derivation clarifies which algebraic initialization conditions allow the reduced implementation to inherit the full-space convergence and complexity guarantees without modifying its local updates.
Read the full abstract ▾
Statistical Methodology
Separating Time-Varying Network Composition from Predictive Dependence under Noisy Network Measurement
Marios Papamichalis, Regina Ruane and Theofanis Papamichalis
A common question about networked time series is whether outcomes changed because shocks transmit more strongly or because the pattern of connections changed. Standard practice inserts a recorded network into an outcome regression and reads movements of the fitted coefficient as changes in transmission strength. When the network is latent, time varying, and measured with error, this reading fails: changes in strength and changes in composition can produce the same outcome distribution at a single date, and the population coefficient moves under composition changes alone. The question becomes answerable when outcomes are analyzed jointly with repeated noisy measurements of the network, such as paired reports of bilateral trade flows. For the joint model we establish necessary and sufficient conditions for local identification,
estimators of the strength and composition paths, a simultaneous confidence band for the strength path, confidence sets that remain exact under weak identification, breakdown bounds under common reporting bias, and an exactly sized test that detects changes on the observed path and attributes them to strength or to composition. Simulations assess each procedure at its stated boundary. On a mirror-reported trade panel of eighteen economies over 1995 to 2020, the diagnostics flag exactly the crisis years and the composition coordinate attached to European Union membership declines by roughly two thirds. The estimand is predictive dependence, not a causal effect.
Read the full abstract ▾
Statistical Methodology
Optimal Variance Reduction in Randomized Experiments
Amir Najmi and Michael D. Keselman
This paper describes an approach to variance reduction in randomized experiments using side information (
covariates of the response unaffected by treatment). As with Double ML[Chernozhukov 2018], models of arbitrary complexity may be employed without concern for bias due to overfitting or regularization. For additive treatment metrics, the approach minimizes variance optimally. For more complex treatment metrics (e.g., multiplicative and ratios) the Delta Method estimate of variance is minimized. Through a variety of examples, the paper also explores modeling considerations.
Read the full abstract ▾
Machine Learning (Statistics) · Cross-listed from cs.LG
Symbolic Neural ODEs: Learning interpretable models from time-series data
Nibodh Boddupalli and Jeff Moehlis
We present a machine learning framework for identifying sparse, interpretable models of dynamical systems directly from time-series data. Our approach parameterizes the underlying vector field using a neural architecture and trains it by minimizing a multi-step prediction loss over a finite horizon. To ensure numerical tractability, we optimize a mean absolute error objective averaged across prediction steps, and progressively increase the horizon during training. A key feature of this formulation is that it enforces consistency under repeated composition of the learned dynamics. As a result, the identified models exhibit significantly improved stability compared with approaches based on one-step regression of the vector field. When combined with sparsity-promoting regularization, this leads to parsimonious models that generalize beyond the training data. We demonstrate accurate recovery of systems exhibiting a wide range of behaviors, including stable and unstable fixed points, periodic orbits, and chaotic attractors. For chaotic systems, while long-term trajectory prediction is inherently limited by sensitivity to initial conditions, we show that multi-step training yields models with accurate short-term dynamics and strong agreement in long-time statistical properties, including mean, variance, and Lyapunov exponents. Moreover, we establish theoretical bounds linking trajectory error to statistical accuracy, providing a step toward a principled explanation for this behavior.
Read the full abstract ▾
Machine Learning (Statistics)
Structured Learning on Mapper Representations
George Babus and Farzana Nasrin
Modern machine learning (ML) methods are highly effective for prediction tasks, but many commonly used representations reduce complex data to fixed dimensional
embeddings that may suppress multiscale structural organization. The Mapper
algorithm from topological data analysis (TDA) provides a different perspective by decomposing data into overlapping local regions connected through a nerve construction, producing a structured representation that captures
geometric organization, local statistical behavior, and relational connectivity simultaneously. In this work, we develop a framework for learning over Mapper induced structured representations. Rather than treating Mapper as a preprocessing step that produces a graph for downstream learning, we treat the full Mapper construction as part of the representation itself. We study mathematical properties of these representations, including invariance under relabeling, a distance functional on the space of Mapper representations, structural complexity of multiscale decompositions, and learning oriented stability under representation perturbations. Experiments on time series and graph classification
datasets validate the proposed framework through controlled studies of representation ablation, Mapper parameter sensitivity, and the geometry of the induced representation space. Together, these results demonstrate how the proposed mathematical framework enables systematic comparison, interpretation, and analysis of Mapper representations, providing practical tools for studying representation geometry, structural complexity, and learning stability in learning tasks.
Read the full abstract ▾
Statistical Methodology
Barycentric Fused Gromov-Wasserstein Balancing for Causal Inference under Multiple Treatments
Yuki Murakami, Takumi Hattori and Kohsuke Kubota
Estimating heterogeneous single and interaction treatment effects from observational data under multiple simultaneous treatments is crucial for decision-making. To mitigate estimation variance, previous studies balance representation distributions between every pair of treatment patterns. However, such pairwise balancing scales quadratically with the number of treatment patterns and fails to preserve consistent local proximity structures across patterns, which degrades counterfactual estimation. To address these challenges, we propose the Causal Inference for Heterogeneous Single and Interaction Treatment Effects Network (CIHSI-Net), a deep learning framework built on a novel Barycentric Fused Gromov-Wasserstein Balancing (BFG-WB) objective. BFG-WB aligns the representation distribution of each treatment pattern with a shared Wasserstein barycenter, achieving global
alignment while reducing the computational complexity from quadratic to linear, and its Fused Gromov-Wasserstein discrepancy preserves the local proximity structures essential for reliable heterogeneous effect estimation. Simulation studies show that CIHSI-Net consistently outperforms state-of-the-art baselines, and an application to real-world marketing data demonstrates its practical utility in complex multi-treatment scenarios.
Read the full abstract ▾
Statistics Theory · Cross-listed from econ.EM
Uniformly Valid Inference Under Interactive and High-Dimensional Constraints
Joseph Fry
Asymptotic normality approximations often fail to hold for extremum
estimators when the true value of the parameter is at or close to the boundary of a parameter space. I analyze and develop tests using a quasi-unconstrained
estimator, which is asymptotically normal even when the true parameter vector is near or at the boundary. These results generalize previous work with this
estimator by allowing for more types of constraints and showing how the method can naturally be modified when a nuisance parameter is also high-dimensional. I show that variations of Wald, Likelihood Ratio, and Lagrange Multiplier tests can control size in a uniform sense, provided the initial constrained
estimator is sufficiently accurate. Lastly, I apply the method to an application involving network estimation with panel data.
Read the full abstract ▾
Machine Learning (Statistics) · Cross-listed from cs.LG
Variance Driven Exploration: A Provable and Efficient Methodology for Pure Exploration in Highly Stochastic Environments
Khang Luong, Nam Nguyen, Hoang Ta et al. (+2 more)
We propose Variance Driven Exploration (VarDE), a principled approach for pure exploration in highly
stochastic environments, where the exploration process is dominated by
stochastic variance. VarDE is built on a fundamental principle: sampling effort should be allocated to minimize the uncertainty of the final decision. We formalize the uncertainty of the final decision through a smooth decision function and derive allocation rules that explicitly capture how
stochastic noise in individual components affects the reliability of the final output. We apply this methodology to three core problems of pure exploration – Best Arm Identification (BAI), Monte Carlo Tree Search (MCTS), and Best-Policy Identification (BPI) – with theoretical guarantees on variance decay and simple regret. Empirically, we demonstrate consistent and significant improvements of VarDE over existing methods, with especially strong gains in highly
stochastic environments.
Read the full abstract ▾
All authors Khang Luong, Nam Nguyen, Hoang Ta, Hung The Tran, Tuan Dam
Machine Learning (Statistics) · Cross-listed from cs.CV
Improved denoising diffusion probabilistic models with efficient non-diagonal covariance modeling
Rui Xia, Ayan Das, Artem Artemev et al. (+3 more)
The sampling process of Denoising
Diffusion Probabilistic Models (DDPMs) can be accelerated by leveraging second-order information in the form of approximations to the denoising posterior covariance – allowing samples of acceptable quality to be produced in fewer but larger sampling steps. Previous attempts at using such information have used drastic (e.g.\ diagonal) simplifications of the covariance. These do not do justice to the peculiar statistical structure of natural images, which exhibit strong non-diagonal correlations between pixels and color channels, and a slow-decaying power-law frequency spectrum. Here, we develop a novel covariance model that captures these features. Our Kronecker-DCT (K-DCT) model uses a Kronecker-factored decomposition of inter-color covariances and spatial covariances modeled in the frequency domain using the Discrete Cosine Transform (DCT). The use of the DCT reduces the computational complexity from quadratic to log-linear, resulting in negligible computational and
memory overhead in each denoising step. By learning K-DCT-structured amortizations of the denoising posterior covariance using pre-trained score models on CIFAR-10, Celeb-A, ImageNet and LSUN
datasets, we show improved performance compared to previous SOTA denoising samplers, both in terms of FID and likelihoods, especially in the regime of few denoising steps.
Read the full abstract ▾
All authors Rui Xia, Ayan Das, Artem Artemev, Andi Zhang, Guillaume Hennequin, Alberto Bernacchia
Statistics Theory
A new matrix-variate integer-valued autoregressive process with matrical negative binomial thinning
Chunhan Liu, Nuo Xu and Kai Yang
To address the overdispersion problem in
matrix-variate integer-valued time series data arising in sociology, medicine, and related fields, this paper proposes a
matrix integer-valued autoregressive model based on the negative binomial thinning operator. By introducing left and right matricial negative binomial thinning operators, the proposed model not only preserves the integer-valued nature of the data but also effectively handles overdispersion. The probabilistic and statistical properties of the proposed model are systematically investigated. Two estimation methods, namely projection estimation and iterative conditional least squares estimation are developed, and the corresponding asymptotic theories are established. Simulation studies provide concrete numerical results to evaluate the finite-sample performance of the
estimators. Real data analysis demonstrates that the proposed model outperforms both the continuous
matrix autoregressive model and the multivariate integer-valued autoregressive model in fitting
matrix-variate integer-valued time series, while also proving effective in accommodating overdispersed count data.
Read the full abstract ▾
Statistics Applications
Bayesian spatio-temporal exposure modelling of air pollution in Rome, Italy, and short-term effects on cause-specific mortality
Edoardo Rosci, Giovanna Jona Lasinio, Paola Michelozzi et al. (+1 more)
Assessing fine-scale spatio-temporal air pollution contrasts in urban contexts is a major challenge for environmental epidemiology. We propose a
Bayesian spatio-temporal model to predict daily concentrations of NO$_2$, PM$_{10}$, and PM$_{2.5}$ in Rome (Italy), over 2011-2022, on a fine grid scale (1 km), using data from 8 to 13 monitoring stations, depending on pollutant. The model includes meteorological and temporal (working day/weekend) fixed effects together with a lag-1 autoregressive spatio-temporal random effect aimed at capturing spatial and daily dependence. Predictive performance was assessed by leave-one-site-out cross-validation. Estimated exposures were then linked to geolocated cause-specific mortality data for Rome (2012-2019), and a case-crossover time-stratified approach was adopted to investigate acute effects. Cross-validation showed good overall predictive performance, with larger errors at high-traffic sites. Estimated exposure (mean lag 0-5) was positively associated with natural-cause mortality, with percent increase in risk of 1.3 (95% CI: 0.6-2.0) for PM$_{10}$, 2.1 for NO$_2$ (1.4-2.9), and 2.4 for PM$_{2.5}$ (1.4-3.3) per 10 $\mu$g/m$^3$ increase. Corresponding estimates when using the city-specific daily average exposure, instead of our 1 km resolution model, were of comparable magnitude. The proposed
Bayesian spatio-temporal framework provides reliable fine-scale exposure estimates for epidemiological use, with results consistent across independent exposure estimates, supporting its application in urban air-pollution health studies.
Read the full abstract ▾
All authors Edoardo Rosci, Giovanna Jona Lasinio, Paola Michelozzi, Massimo Stafoggia
Other Statistics
Inferential Validity of Digital Health Measures
Carmen D. Tekwe, Mercy Oladuti, Yuanyuan Luan et al. (+5 more)
Digital health measures increasingly inform treatment evaluation, risk classification, clinical monitoring, and regulatory decisions. Existing validity concepts concern a measure's technical soundness, clinical meaningfulness, usability, and scalability. Inferential validity concerns how well a measure supports a scientific, clinical, or regulatory conclusion. We propose assessing inferential validity as a downstream evaluation layer that links measurement system evidence to trustworthy conclusions.
Read the full abstract ▾
All authors Carmen D. Tekwe, Mercy Oladuti, Yuanyuan Luan, Andi Mai, Orfeu M. Buxton, See Ling Loy, Jeffrey S. Gonzalez, Roger S. Zoh
Machine Learning (Statistics)
Guidance for Prior Change via Density Ratio Estimation
Yichen Zang, Song Liu and Jiun-Yi Lin
Simulation-Based Inference (SBI) serves as a vital framework for parameter inference in scientific fields where simulators involve intractable likelihoods, yet while amortized generative models offer rapid posterior estimation, they are often restricted by the specific priors used during training, thereby limiting their flexibility as prior knowledge evolves. To address this prior dependency, PriorGuide was introduced as an inference-time guidance method, but due to its intractable formulation, it relies on Gaussian approximations of the reverse transition kernel and Gaussian mixture model fitting for the prior ratio, both of which introduce systematic bias. Motivated by these limitations, we propose an unbiased test-time guidance framework that leverages Density Ratio Estimation (DRE) to learn a score guidance term, effectively decoupling the inference process from the prior training. Moreover, our framework remains agnostic to the specific density ratio
estimators, making it a general and flexible framework for handling prior changes. Experimental results across multiple tasks demonstrate that our method matches or outperforms PriorGuide on C2ST and MMD in most tasks while maintaining robustness even under limited overlap between the training and target priors. Furthermore, we apply our method to
Bayesian updating for parameter inference from planetary light-curve data, where it also demonstrates strong effectiveness and robustness. Code is available at https://github.com/a-chenchen/dre-based-prior-guidance .
Read the full abstract ▾
Statistical Methodology
Gaussian-efficient testing by betting on the mean of bounded data
Diego Martinez-Taboada and Aaditya Ramdas
Given $[0,1]$-valued random variables $X_1,\dots,X_n$ such that $\mathbb{E}[X_i | X_1,\dots,X_{i-1}]= \mu$ for all $i$, we propose a new nonasymptotic confidence interval for $\mu$ that is obtained by inverting terminal e-values generated by a novel betting strategy. When the data are iid, its limiting width matches that of the central limit
theorem (“Gaussian-efficient”), finally surpassing the inefficient limits of previous betting intervals. Our main conceptual advance involves designing betting fractions that track the conditional rejection probability of the most powerful terminal test in a limiting Gaussian experiment. When one predictable variance
estimator is shared across candidate means, the deterministic inversion is an interval for every data sequence and its two endpoints can be found easily. The width can be improved further with external randomization. In simulations, our method yields the tightest intervals to date; for every distribution tested and all sufficiently large $n$, our deterministic version beats
STaR-Bets and is competitive with Gaffke, while the randomized improvement beats both. It thus combines finite-sample validity under martingale dependence, easy endpoint computation, Gaussian-efficient inference for iid data, and excellent empirical performance. We also extend the construction and its efficiency theory to sampling without replacement, where it again achieves state-of-the-art empirical performance.
Read the full abstract ▾