Statistical Methodology · Cross-listed from stat.ML
On the Tightness and Computational Tractability of Higher-Dimensional Confidence Sequences
Fabian Denoodt, Sibylle Hess, Joaquin Vanschoren et al. (+1 more)
Modern sequential monitoring problems often involve multiple metrics, where we monitor several data streams simultaneously and may act once the evidence is strong enough. Confidence sequences (CSs) are a natural tool for such continuous monitoring. However, for bounded vector means, existing multivariate CSs are either tight but computationally intractable, or fast to compute but conservative. To address this, we study three lifts of one-dimensional betting-based CSs to higher dimensions: a weighted Bonferroni region, an equivalent max-wealth form, and a portfolio region. The portfolio is typically much tighter, especially in higher dimensions, but its boundary and properties such as volume are not available in closed form. To make this tighter construction usable, we propose tractable outer approximations of the portfolio region that preserve statistical validity: a bounding box, an $\ell_p$-ellipsoid, and their intersection. We prove set relations among all constructions and show empirically that these approximations (i) achieve regions close to the intractable portfolio, (ii) substantially outperform existing tractable multivariate CSs, and (iii) enable practical use cases such as multi-metric A/B testing and model comparison.
Read the full abstract ▾
All authors Fabian Denoodt, Sibylle Hess, Joaquin Vanschoren, Christian A. Naesseth
Statistical Methodology
Regression to the Mean-Adjusted Sample-Size Determination for Cutoff-Selected Single-Arm Pre-Post Studies
Ariel Linden
Studies enrolling participants on the basis of an extreme baseline value are susceptible to regression to the mean (RTM), such that some observed pre-post change is expected even without treatment. Existing methods estimate and decompose RTM retrospectively. We extend this framework to prospective study design by deriving a closed-form sample-size method for continuous, cutoff-selected, single-arm pre-post studies. The method partitions anticipated total change into that expected from RTM and the residual treatment effect, and powers the study to detect the latter. It uses the general bivariate-normal RTM expression, allowing baseline and follow-up variances to differ, and incorporates the corresponding conditional variance of the pre-post change. To our knowledge, no published method or software implements this cutoff-based RTM framework for prospective closed-form sample-size determination in this setting. The Stata command power onemean_rtm provides solutions for sample size and minimum detectable effect, normal-theory power evaluation, attrition adjustment, and sensitivity analysis. Monte Carlo simulation across 58 scenarios demonstrated accurate Type I error control and showed that achieved power rapidly approached nominal power as sample size increased, with the closed-form calculation generally conservative at very small sample sizes.
Read the full abstract ▾
Statistical Methodology
A Hybrid Spatial Statistical Learning Framework for Individualized Probability Estimation: Application to Multisite Autism Neuroimaging
Montserrat Fuentes and Veronica B. Patterson
Autism spectrum disorder is a heterogeneous neurodevelopmental condition whose functional
brain organization varies across individuals and imaging centers. Resting-state functional connectivity provides an opportunity to study this variation, but analysis is complicated by high dimensionality, strong dependence among connections, and substantial site heterogeneity. We introduce a Hybrid Spatial Statistical Learning Framework for individualized probability estimation in multisite autism neuroimaging. The framework combines edge-level connectivity, graph-based network organization, and participant characteristics as complementary representations of a common probability target. Fine-scale connectivity retains discriminatory information, while broader representations stabilize probability estimates under site shift. All preprocessing and model development are performed within complete site-held-out validation to assess transportability to unseen acquisition environments. Simulations show that the hybrid preserves the discrimination of the strongest edge model while improving probability accuracy as between-site heterogeneity increases. In 860 participants from 20 ABIDE sites, the hybrid retained ROC AUC while reducing Brier score and log loss. These results show that multiscale integration can improve the reliability and transportability of individualized probabilities from complex, spatially dependent biomedical data.
Read the full abstract ▾
Statistical Methodology
Bayesian Tensor Regression for Neuroimaging Data
Zahra Naji, Montserrat Fuentes, Liangsuo Ma et al. (+1 more)
Multidimensional array data, or tensors, arise naturally in neuroimaging and other high-dimensional applications. We propose a parsimonious
Bayesian tensor regression model for studies in which a
brain image is the response and predictors are vector-valued
covariates. The method extends
Bayesian envelope dimension reduction to tensor responses, identifying material subspaces that contain regression information while removing variation that is immaterial to the predictors. This formulation leads naturally to a Tucker tensor decomposition and allows spatial dependence and multiple sources of uncertainty to be modeled jointly. We develop a computationally feasible Markov chain Monte Carlo
algorithm based on Gibbs sampling and establish posterior consistency for the proposed model. Simulation studies demonstrate substantial gains in estimation accuracy and uncertainty quantification when meaningful dimension reduction is present. We apply the method to Human Connectome Project neuroimaging data to investigate associations between alcohol use and
brain activity. The results illustrate the value of
Bayesian tensor envelope regression for inference with high-dimensional, spatially dependent imaging responses.
Read the full abstract ▾
All authors Zahra Naji, Montserrat Fuentes, Liangsuo Ma, Hossein Moradi Rekabdarkolaee
Statistical Methodology
Estimating the True Effect Size Distribution with SIMEX
Zhaoqi Li, Daniel Ting, Ilya Gorbachev et al. (+2 more)
Large-scale online experimentation produces noisy effect estimates, which can overstate gains and complicate decisions about launches and testing policies. We propose a nonparametric method based on SIMulation-EXtrapolation (SIMEX) to estimate the latent distribution of true effects from estimated average treatment effects with known variances. The method evaluates
quantiles after adding progressively more simulated measurement noise and extrapolates the resulting inverse cumulative distribution function to the zero-noise setting while enforcing monotonicity of the
quantiles. In a synthetic example with normally distributed true effects and measurement error, the method recovers the underlying effect distribution and performs nearly as well as a parametric empirical Bayes normal means approach. This provides a flexible way to characterize effect-size distributions without fully specifying a parametric model.
Read the full abstract ▾
All authors Zhaoqi Li, Daniel Ting, Ilya Gorbachev, Ehsan Emamjomeh-Zadeh, Houssam Nassif
Statistical Methodology
A Sparse-Group Pliable Lasso
Mohammad Javad Davoudabadi, Minh Long Nguyen, Amirhossein Ghatari et al. (+2 more)
The sparse-group pliable Lasso (SGPL) extends the pliable Lasso and group pliable Lasso by combining sparse-group regularization with a predictor-level coupling penalty, enabling simultaneous group-level selection, within-group sparsity, and hierarchical structure between main effects and interactions. We propose a blockwise coordinate descent
algorithm for fitting the SGPL that exploits the convexity and structure of the objective function, establish convexity and Karush–Kuhn–Tucker optimality conditions, and prove that the
algorithm converges to a global minimizer. Simulation studies demonstrate competitive predictive performance and smaller interaction estimation error than the pliable Lasso and group pliable Lasso, albeit with the expected precision–recall trade-off in support recovery. We further illustrate the proposed method using a Parkinson's disease gut microbiome study and an adrenocortical carcinoma (ACC) copy-number
dataset from The Cancer Genome Atlas. The Parkinson's application identifies interpretable interactions between microbial abundances and dietary variables, while the ACC application illustrates that the effectiveness of group-structured regularization depends on how well the prespecified grouping reflects the underlying signal structure.
Read the full abstract ▾
All authors Mohammad Javad Davoudabadi, Minh Long Nguyen, Amirhossein Ghatari, Mina Aminghafari, Kerrie Mengersen
Statistical Methodology
$K$-functions for point processes on complex surfaces
Francisco Cuevas-Pacheco, Scott Ward, Ed Cohen et al. (+1 more)
The $K$-function is a fundamental summary statistic for assessing clustering or regularity of point processes in two or three dimensional Euclidean space. In practice, however, many planar point patterns arise from projecting locations of objects on a surface in three dimensional space to two dimensional space. For example, when events or objects occur in a landscape their elevation is often ignored. This can lead to erroneous conclusions regarding properties of the point process generating the point pattern. There is not a unique way to extend the classical $K$-function to point patterns on a complex surface. In this paper we propose, explore, and discuss several approaches in terms of their theoretical and computational properties. The best performing approach, coined the surface area $K$-function, can be viewed is an analogue of the classical $K$-function replacing counts of points in Euclidean balls with counts of points in surface geodesic balls. However, an important distinction is that the argument of our surface area $K$-function is area instead of radius of geodesic balls. The performances of the various surface $K$-functions are compared in applications to simulated and real data.
Read the full abstract ▾
All authors Francisco Cuevas-Pacheco, Scott Ward, Ed Cohen, Rasmus Waagepetersen
Statistical Methodology · Cross-listed from stat.ML
Random Hazard Forests
Hemant Ishwaran, Eileen M. Hsich, Udaya B. Kogalur et al. (+1 more)
Clinical data sources such as electronic health records and wearable sensors record patient status repeatedly over follow-up, often at irregular times and on different schedules for different measurements. These data create opportunities for continuously updated, individualized risk prediction. Existing approaches, however, often simplify the temporal structure for model fitting. We introduce Random Hazard Forests (RHF), a survival tree ensemble that estimates how a patient's hazard changes in continuous time as new measurements become available. The method formulates the estimation problem directly through a nonparametric hazard likelihood for predictable
covariate processes. An efficient working model guides tree construction, after which flexible time-varying hazards are estimated for each terminal node. Given any predictable
covariate path, each tree follows the path through its terminal nodes over time and assembles the corresponding node-level hazards into a trajectory. Averaging these trajectories across trees yields the pathwise hazard estimate. Because routing at each time uses only the
covariate state available immediately beforehand, the construction accommodates internal longitudinal
covariates without lookahead. Simulations and an intensive care application show that the forest accurately estimates changing risk under irregular and asynchronous
covariate updates.
Read the full abstract ▾
All authors Hemant Ishwaran, Eileen M. Hsich, Udaya B. Kogalur, Donald K.K. Lee
Statistical Methodology
Outlier Impact: Detection by Consequences
Daniel Ting, Ilya Gorbachev and Sammy Shen
We introduce a novel outlier detection method that utilizes a concrete measure of the statistical impact of an outlier rather than a vague notion of "unusualness". This allows practitioners to only flag points that materially affect the inferences made from the data while also ensuring these points are anomalous. This is of particular interest in experimentation, where outliers affect the validity of the causal inferences. In particular, we consider a potential outlier's impact on the mean and the False Positive Rate (FPR) of a hypothesis test.
Read the full abstract ▾
Statistical Methodology · Cross-listed from stat.ML
Sparse Separable Factor Analysis in the Complex Domain with an Application to Local Field Potential Data
Ian Hultman, Kirtikanth Kalapatapu, Yassine Filali et al. (+2 more)
Complex-valued arrays arise in signal processing, where scientific interpretation depends on retaining amplitude and phase information. Existing covariance estimation methods either ignore the multiway organization of such data or rely on real-domain
embeddings that do not directly exploit their complex structure. We develop sparse separable factor analysis (SSFA), a latent factor model for complex-valued arrays with a separable covariance structure across modes. Each mode-specific covariance
matrix is modeled through a low-rank Hermitian factor structure and a diagonal residual covariance
matrix. To obtain interpretable estimates, we impose elementwise lasso penalties on the complex loading
matrices and estimate the SSFA parameters using a mode-wise parameter-expanded expectation-maximization procedure. The resulting loading updates admit closed-form complex soft-thresholding solutions, which shrink the modulus of each loading while preserving its phase. A separate balancing step resolves the scale nonidentifiability of the separable covariance structure. Simulation studies show that SSFA improves covariance estimation relative to vectorization-based methods, including complex principal component analysis. We apply SSFA to local field potential recordings from mice, where we compare separability structures induced by different groupings of
brain region, frequency, and time and perform model-based imputation of recordings missing because of electrode misplacement.
Read the full abstract ▾
All authors Ian Hultman, Kirtikanth Kalapatapu, Yassine Filali, Rainbo Hultman, Sanvesh Srivastava
Statistical Methodology · Cross-listed from stat.ML
A Data-Driven Approach to State Construction in Markov Models
Linde Van Gestel, Marie-Anne Guerry and Evy Rombaut
A Markov chain is a widely used
stochastic process modelling random events over time. These models are built on subsets of the entire
dataset, referred to as states, which are considered to be homogeneous regarding transition probabilities. However, the creation of these states is often disregarded or based on prior assumption, potentially violating the homogeneity requirement and thus decreasing the validity and predictive power of the model. In order to fill this gap, this paper combines supervised feature selection with unsupervised learning techniques for data-driven state construction. Density-based clustering, spectral clustering, and Kohonen self-organizing maps are examined for their ability to identify latent groups without prior assumptions. The contribution of this study is twofold. First, the paper presents a methodological framework for state construction incorporating suitable unsupervised learning techniques, with appropriate measures both for classification performance and Markov model accuracy. Secondly, the framework is tested on an application, resulting in a comparative analysis showing that spectral clustering and Kohonen self-organizing maps are best at capturing inherent structure. These results serve as a cornerstone in providing theoretical and methodological guidance for improving state definition in applied Markov modelling.
Read the full abstract ▾
Statistical Methodology · Cross-listed from cs.HC
Event-Time Confounding Under Bursty Human Dynamics
Michael Iannelli and Alan Ai
Studies of digital behavior often align users at moments they choose, such as opening an AI assistant, clicking a recommendation, or visiting a product page, and interpret higher activity afterward as an event effect. We show how this creates an endogenous time zero: the event occurs during an ongoing task episode, so the aligned curve can trace episode continuation rather than a response to the event. In same-user, cross-surface web logs, AI, shopping, news, coding, and reference events are all preceded by broad activity increases that peak before time zero. Our strongest test uses known-null timestamps that cause nothing. Among the 5.8% of AI responses meeting strict pre-event activity and washout criteria, these timestamps show 3.42 times the post-event search activity of a within-user placebo, compared with 4.32 times for real events. The fraction of excess reproduced by the known null falls from 0.56 at detectably active moments to -0.04 at quiet moments, where the design detects none. We formalize this episode-selection bias, prove that a single-surface event window cannot separate it from a genuine effect without additional assumptions, and show in zero-effect simulations why user fixed effects and coarse activity matching can fail: the confound is within-user and time-varying. We provide a diagnostic protocol, public-data
benchmarks, and burstcheck, a lightweight audit tool. User-timed events may have real effects, but post-event volume does not identify them by default; studies should compare similar episodes with and without the event.
Read the full abstract ▾
Statistical Methodology
Further Results on Controlling the False Discovery Rate in Two-Sided Gaussian Mean Testing
Deepra Ghosh and Sanat K. Sarkar
The recent work of Sarkar and Zhang (2025) introduced Positive Tail Dependence Under the Null (PTDN) and developed Generalized Shifted Benjamini-Hochberg (BH) procedures for two-sided Gaussian $z$- and $t$-testing under known covariance structures. This paper develops further consequences of that framework. First, we derive explicit dependence-adaptive lower and upper bounds for the FDR of the original BH procedure in terms of the conditional variance parameters $\tau_i=1-R_i^2$, where $R_i^2$ is the squared multiple correlation between the $i$th statistic and the remaining coordinates. These bounds recover the exact BH FDR under independence and provide finite-sample, covariance-specific information complementary to generic bounds. We also identify conditions under which the coordinate-specific calibration of shifted BH can provide a rejection advantage over the original BH procedure. Second, we consider the practically important setting in which the covariance
matrix is unknown but an independent Wishart
estimator is available. Using simultaneous lower confidence bounds for the $\tau_i$'s, we construct a confidence-bound shifted BH procedure and establish finite-sample FDR control. To our knowledge, this is the first shifted-BH-type procedure with a finite-sample guarantee for two-sided Gaussian mean testing under a completely unknown covariance
matrix estimated independently. Numerical studies illustrate the behavior of the covariance-adaptive bounds, the potential advantage of shifted BH over BH, and the performance of confidence-bound shifting under unknown covariance.
Read the full abstract ▾
Statistical Methodology
LABS: Extending the scope of binary segmentation via a look-ahead device
Piotr Fryzlewicz
Binary segmentation is widely used for multiple change-point detection because it is fast, simple to describe, and simple to implement. Its validity rests on the requirement that, at each recursive stage, the procedure identifies one of the true change-points when several are present in the current interval. This holds for detecting changes in mean using the CUSUM statistic, but fails in some other settings, in particular in slope change detection for continuous piecewise-linear signals. We propose Look-Ahead Binary Segmentation (LABS), a modification in which the change-points returned by the two child recursions define a narrower interval on which the parent estimate is re-evaluated. LABS inherits the computational speed of standard binary segmentation, but achieves the near-optimal consistency rate of $O\{(n\log n)^{1/2}\}$ in the slope-change signal setting when the LABS model is chosen via either thresholding or a Schwarz-like information criterion. Simulations show that LABS is fast and achieves state-of-the-art performance.
Read the full abstract ▾