Statistical Methodology · Cross-listed from cs.AI
When Prediction Error Is Not Enough: Evaluating Nuisance-Function Prediction for Causal Estimation
Cong Cao
Prediction error is widely used to evaluate nuisance-function
estimators in causal inference, but its relationship with causal
estimator performance may differ across performance measures. We studied this question in a partially linear model using Monte Carlo simulations. We compared ordinary least squares (OLS), generalized additive models (GAMs), XGBoost, and Double Machine Learning with XGBoost (DML-XGBoost), evaluating nuisance-function prediction error, bias, RMSE, and 95% confidence interval coverage. We also examined a simple joint-error measure based on the absolute cross-product of estimation errors from the exposure and outcome nuisance functions. Across the simulated settings, XGBoost had the lowest RMSE among the non-oracle methods, while DML-XGBoost generally provided better confidence interval coverage. Prediction error did not consistently track causal bias across methods and settings, and the method with the best point-estimation performance did not necessarily have the best confidence interval coverage. The joint-error measure was only weakly associated with causal bias and did not provide a useful standalone measure of causal performance. These results suggest that prediction error is useful for assessing nuisance-function estimation, but it should not be treated as a direct measure of the quality of the resulting causal
estimator.
Read the full abstract ▾
Statistical Methodology
Robust K-means Clustering using the Density Power Divergence Measure
Anirban Mondal, Paromita Banerjee and Abhijit Mandal
We introduce a robust clustering method, MK-means DPD, that estimates cluster centers and covariance
matrices using density power divergence (DPD) measures combined with Mahalanobis distance, making it resistant to outliers and adaptable to heterogeneous, elliptical clusters, unlike the classical K-means
algorithm. Since Mahalanobis distance-based K-means lacks a general convergence guarantee, we further introduce a convergent variant, Density-Consistent MK-means DPD (DC-MK-means DPD), which redefines the cluster assignment step in terms of a pointwise DPD loss. We prove a formal
theorem establishing that the resulting
algorithm converges in a finite number of steps. We also propose two new robust internal evaluation indices, a Median Davies-Bouldin Index and a Trimmed Calinski-Harabasz Index, to ensure that performance comparisons are not themselves distorted by outliers. The efficacy of the proposed methods is demonstrated on simulated data, showing superiority over existing methods, and on two real
datasets: Iris data, to identify similar species, and COVID-19 case fatality rate and infection rate data for countries worldwide, examining the resulting clusters' geographic and socio-economic patterns.
Read the full abstract ▾
Statistical Methodology · Cross-listed from math.ST
Self-normalization for Spectral Density Integrals
Holger Dette and Sebastian Kühnert
Integrals of spectral densities are frequently used to summarize spectral characteristics of linear processes. This work studies self-normalization for
estimators of such integrals based on sequential periodograms and establishes weak convergence of the corresponding processes. For linear functionals of the spectral density, self-normalization yields pivotal limiting distributions that are free of unknown spectral quantities. For non-linear functionals, however, additional components with distinct covariance structures may arise in the limiting process. We demonstrate this phenomenon for the integrated squared spectral density.
Read the full abstract ▾
Statistical Methodology
Modelling compositional data with structural zero values
Omar Alzeley and Michail Tsagris
Compositional data are positive multivariate data whose sum equals 1. A popular method to analyze such data is via log–ratio transformations, which are however not applicable when zero values are present. In this paper we present a conditional logistic normal distribution suitable for compositional data with structural zero values. The model is applicable to arbitrary dimensions and the EM
algorithm guarantees a fast implementation. The model accepts predictors and we provide a residual analysis. We further provide principal component analysis and biplots for visualization of compositional data with zero values present. Simulation studies and real data examples illustrate the performance of the model, with and without
covariates, and compare it to the Dirichlet analogue.
Read the full abstract ▾
Statistical Methodology
Design of Experiment in Complex Systems based on Computational Taxonomy
Eric Goldman and Fushing Hsieh
Via Computational Taxonomy (CT), we develop Design of Experiment(DoE) based on rigorously redefined constituting ingredients of complex system dynamics: randomness, nonlinearity and even class, through a data-driven constructed Taxonomic Hierarchy. As an opposite quest of Classification without man-made assumptions and structures, we illustrate this new perspective of DoE through a civil engineering complex system: Concrete Compressive Strength (CCS). CT begins by building a Taxonomic Hierarchy as a heterogeneity-vs-homogeneity map framed with a tree geometry to represent CCS-system dynamics. At each internal node of this hierarchy, a heatmap is computed via Scientific Data Analysis (SDA) to reveal locality-embraced heterogeneity through block structured
covariate homogeneity annotated with response's locality-split. Only arriving at each ending-node of this hierarchy, coherence of homogeneity is achieved on both response and
covariate sides. As such a class of finite sample nature is computationally recognized and confirmed. In contrast, nonlinearity is evidently observed as incoherence of response-vs-
covariate homogeneity when comparing two classes located on two distinct branches. This hierarchy explicitly maps out system's randomness and nonlinearity to serve as a scientific basis for any DoE quest. Design of Experiment (DoE) for any designated class is redefined as a search for a
covariate subspace that embraces the class-representative randomness and at the same time avoids potential nonlinearities with respect to the rest of classes. This is a brand-new theme of DoE.
Read the full abstract ▾
Statistical Methodology
Spatial-sign-based multilinear principal component analysis for tensor data
Dongxu Yang, Wanfeng Liang, Le Zhou et al. (+1 more)
Multilinear principal component analysis (MPCA) reduces the dimension of tensor-valued data while preserving their mode-specific structure, but its quadratic scatter criterion can be unstable under heavy-tailed distributions and contamination. We propose spatial-sign-based multilinear principal component analysis (SMPCA), a robust dimension-reduction method that centers the observations by their spatial median, removes radial magnitude through spatial-sign normalization, and estimates the mode-wise loading spaces by alternating eigendecompositions. Under a separable tensor elliptical model, we show that the target mode-wise loading spaces uniquely maximize the population criterion and that one complete sweep of exact population block updates recovers them from any initialization. We also characterize exactly when their tensor-product subspace coincides with a leading unrestricted subspace of vectorized spatial-sign PCA and, when finite second moments exist, ordinary vectorized PCA. At the sample level, we derive explicit statistical rates for the mode-wise subspaces and the joint multilinear projector, obtain corresponding reconstruction guarantees, establish consistency of the cumulative-contribution dimension selector, and prove that the objective values generated by exact cyclic updates are nondecreasing and convergent. Simulations and an empirical application show that SMPCA is more accurate and stable than competitors under heavy-tailed distributions and outlier contamination, while retaining competitive performance under light-tailed settings.
Read the full abstract ▾
All authors Dongxu Yang, Wanfeng Liang, Le Zhou, Long Feng
Statistical Methodology
Worst-Case Win Ratios Under Partially Specified Outcome Hierarchies
Kexuan Li, Xue Fan and Lingli Yang
Win statistics require a prespecified outcome hierarchy. Clinical teams sometimes agree only on the highest priority outcome, leaving the order of lower priority outcomes unresolved, and clinically meaningful thresholds may be specified as ranges. Separate sensitivity analyses describe how the results change. A single inference for the full set of planned analyses is generally absent. We define the estimand as the smallest net benefit among the comparison rules allowed by the protocol or statistical analysis plan. Each rule uses the usual two-sample U-statistic. Large-sample results are developed for a finite list of rules and for a continuous threshold range. Inversion of an intersection-union test gives a one-sided lower confidence bound, with no multiplicity adjustment for the single claim that every individual net benefit is positive. Simulations show valid one-sided coverage and illustrate the gap between a favorable result for one selected hierarchy and a favorable result across all prespecified hierarchies. An application to ACTG 175 shows how the ordering of laboratory outcomes can affect the strength of the conclusion. A further example identifies an unfavorable threshold that is missed by a sparse grid.
Read the full abstract ▾
Statistical Methodology
A Generalized Ridge Regression and Convolutional LASSO
Shintaro Yoshizawa
We derive the complete duality theory underlying the Hodrick–Prescott filter, whose rank-deficient second-difference penalty admits infinitely many equivalent trend representations via generalized inverses. Constructing two canonical choices—the Moore–Penrose-based B-representation and an alternative A-representation—we prove that the extracted trend is invariant across representations, obtain a closed-form Bregman-type divergence quantifying their disagreement under a shared coefficient vector, and show this divergence vanishes as $\lambda\to\infty$. We further mollify the non-smooth $\ell_1$ trend filter with a compactly supported biweight kernel to obtain a closed-form $C^3$ Convolutional LASSO that restores Newton-type quadratic convergence without sacrificing the kink- setecting character of $\ell_1$ regularization. Theoretical results are verified numerically and benchmarked against ADMM/IRLS on NVIDIA's 2013–2018 daily closing prices, where the sparse filter isolates genuine growth-regime breaks—chiefly the November 2016 post-earnings acceleration—cleanly separated from the smooth $L_2$ trend.
Read the full abstract ▾
Statistical Methodology
A Unified Approach to Interpretable Causal Root Cause Attribution
Jing Zhou, Dominik Janzing, Sepp Tsang et al. (+2 more)
Understanding why a target metric changes is a fundamental problem in data-driven decision making, beyond anomaly detection alone. We study root cause attribution for metric changes in complex e-commerce systems, focusing on trade-offs between interpretability, efficiency, and causal validity. As a starting point, we extend a metric-decomposition method into a recursive metric-tree framework for multi-level root cause analysis, but this relies on independence and decomposability assumptions that miss complex causal dependencies. In contrast, graphical causal models (GCMs) relax these assumptions and improve causal validity, at the cost of interpretability, higher computational and data demands, and potential attribution target misalignment. Through real-world applications, mathematical proofs, and simulations, we characterize the fundamental sources of these trade-offs. Guided by these insights, we propose a unified, causally informed attribution approach that integrates structural causal information into the metric-tree decomposition framework and corrects key sources of misalignment in GCM-based causal attributions, substantially improving causal validity while preserving interpretability and fast computation. Analytical proofs and simulations demonstrate that the proposed approach produces more accurate root cause attributions, and we also present a real-world application.
Read the full abstract ▾
All authors Jing Zhou, Dominik Janzing, Sepp Tsang, Patrick Blöbaum, Marco Visentini Scarzanella
Statistical Methodology
One-step group factor analysis via penalized least squares
Xinbing Kong, Xiaoying Pan, Long Yu et al. (+1 more)
In this article, we revisit the problem of group factor analysis and propose a one-step penalized least squares method to estimate the factor loadings and factors in large-dimensional group factor models, offering a distinct alternative to the conventional two-step principal component approach. Our procedure originates from the equivalence between the group factor structure and the carefully tailored identification conditions. Leveraging this insight, we develop a tricky Lagrange multiplier formulation for a penalized least square loss function. This one-step optimization framework, combined with the fine-tuned penalty parameters, facilitates the direct derivation of central limit
theorems for factor loadings, factor scores, common and local components, as well as the convergence rates for them. Our theory demonstrates that our one-step approach achieves the same rate as the two-step aggregated principal-component method and even the same limiting standard error in the balanced group panel case, but smaller limiting standard error than the two-step canonical correlation procedure. Extensive simulation studies justify the theory. Applications to U.S. house prices and CSI300 weekly returns confirm that our method identifies global factors and heterogeneous local patterns.
Read the full abstract ▾
All authors Xinbing Kong, Xiaoying Pan, Long Yu, Tong Zhang
Statistical Methodology
Adaptive Functional Clustering with Structured Dependence via Variational Inference
Seojin Lee, Neulpum Jeong and Seonghyun Jeong
Functional clustering is an important tool for identifying latent heterogeneity in functional data and has been widely applied across various scientific fields. However, many existing methods are not fully adaptive, as they may require the number of clusters to be prespecified and may lack automatic control over the smoothness of the underlying functions. They also commonly assume independent and identically distributed errors, thereby overlooking additional within-curve dependence. We propose a fully adaptive
Bayesian procedure for functional clustering that addresses these limitations through Dirichlet process priors, adaptive smoothness control, and flexible covariance modeling. For computational scalability, the proposed method employs variational inference as an efficient alternative to Markov chain Monte Carlo. Together, these features provide a unified
Bayesian framework for functional clustering and cluster-specific mean function estimation in the presence of structured within-curve dependence.
Read the full abstract ▾
Statistical Methodology
Prognosis-equivalent mapping of clinical measurements via survival analysis
Kazuharu Harada and Mitsunori Ogawa
A continuous clinical measurement recorded in fixed physical units may have different prognostic meaning across patients when its effect depends on a patient-level modifier. For example, the same tumor diameter may imply markedly different prognosis in an infant and an adult, because patient size can modify its prognostic effect. We formalize this problem through prognosis-equivalent mapping for time-to-event outcomes. The resulting estimand maps a measurement value observed at one modifier level to the value under a reference modifier level that yields the same conditional prognostic quantity. The basic operation is to equate a monotone conditional prognostic score and invert the reference-side curve. In observational data, however, treatment may be selected according to the modifier and the measurement, so a direct equate-and-invert procedure may reflect differences in treatment assignment as well as the prognostic meaning of the measurement itself. We therefore define, in addition to a direct approach, a policy-standardized mapping that standardizes treatment under a common policy using the g-formula. We also introduce an origin-referenced mapping that compares changes in prognostic score from a common anchor, thereby separating modifier-specific prognostic levels from modifier dependence in the measurement–prognosis relationship. Using Cox models, we develop linear and flexible inversion
estimators with analytic and bootstrap confidence bands. Simulations evaluate finite-sample performance and illustrate how treatment standardization and origin referencing clarify what is being mapped.
Read the full abstract ▾