Machine Learning (Statistics) · Cross-listed from cs.CR
On the Optimal Number of Grids for Differentially Private Non-Interactive $K$-Means Clustering
Gokularam Muthukrishnan and Anshoo Tandon
Differentially private $K$-means clustering enables releasing cluster centers derived from a
dataset while protecting the
privacy of the individuals. Non-interactive clustering techniques based on privatized histograms are attractive because the released data synopsis can be reused for other downstream tasks without additional
privacy loss. The choice of the number of grids for discretizing the data points is crucial, as it directly controls the quantization bias and the amount of noise injected to preserve
privacy. The widely adopted strategy selects a grid size that is independent of the number of clusters and also relies on empirical tuning. In this work, we revisit this choice and propose a refined grid-size selection rule derived by minimizing an upper bound on the expected deviation in the K-means objective function, leading to a more principled discretization strategy for non-interactive private clustering. Compared to prior work, our grid resolution differs both in its dependence on the number of clusters and in the scaling with
dataset size and
privacy budget. Extensive numerical results elucidate that the proposed strategy results in accurate clustering compared to the state-of-the-art techniques, even under tight
privacy budgets.
Read the full abstract ▾
Statistical Methodology
Adaptive procedures for boundary FDR control
Sarah Mostow and Daniel Xiang
A cornerstone of the multiple testing literature is the Benjamini-Hochberg (BH) procedure, which guarantees control of the FDR when $p$-values are independent or positively dependent. While BH controls the average quality of rejections, it does not provide guarantees for individual discoveries, particularly those near the rejection threshold, which are more likely to be false than the average rejection. For independent $p$-values with Uniform$(0,1)$ null distribution, the Support Line procedure (SL; arXiv:2207.07299) provably controls the error probability for the rejection at the edge of the discovery set (i.e. the one with largest $p$-value) at level $q m_0/m$, where $m_0$ is the number of true null hypotheses and $q$ is a tuning parameter. In this work, we study adaptive versions of the SL procedure that operate in two steps: the first step estimates $m_0$ from non-significant statistics, and the second step runs the SL procedure at an adjusted level $q m / \hat{m}_0$. The adaptive procedures are shown to control the false discovery probability for the "boundary” rejection under an independence assumption. Simulation studies suggest that some but not all of the two-stage procedures maintain error control under positive dependence, and that substantial power is gained relative to the original SL procedure. We illustrate differences between the procedures on meta-data from the recent literature in behavioral psychology on growth mindset and nudge interventions.
Read the full abstract ▾
Statistics Theory · Cross-listed from cs.LG
High dimensional theory of two-phase optimizers
Atish Agarwala
The trend towards larger training setups has brought a renewed interest in partially asynchronous two-phase optimizers which optimize locally and then synchronize across workers. Additionally, recent work suggests that the one-worker version of one of these
algorithms, DiLoCo, shows promising results as a (synchronous) optimizer. Motivated by these studies we present an analysis of LA-DiLoCo, a simple member of the DiLoCo family, on a high-dimensional linear regression problem. We show that the one-worker variant, LA, provides a different tradeoff between signal and noise than SGD, which is beneficial in many scenarios. We also show that the multi-worker version generates more noise than the single worker version, but that this additional noise generation can be ameliorated by appropriate choice of hyperparameters. We conclude with an analysis of SLA – LA with momentum – and show that stacking two momentum operators gives an opportunity for acceleration via a non-linear transformation of the "effective” Hessian spectrum, which is maximized for Nesterov momentum. Altogether our results show that two-phase optimizers represent a fruitful new paradigm for understanding and improving training
algorithms.
Read the full abstract ▾
Machine Learning (Statistics)
Static and Dynamic Approaches to Computing Barycenters of Probability Measures on Graphs
David Gentile and James M. Murphy
The optimal transportation problem defines a geometry of probability measures which leads to a definition for weighted averages (barycenters) of measures, finding application in the machine learning and computer
vision communities as a signal processing tool. Here, we implement a barycentric coding model for measures which are supported on a graph, a context in which the classical optimal transport geometry becomes degenerate, by leveraging a Riemannian structure on the simplex induced by a dynamic formulation of the optimal transport problem. We approximate the exponential mapping associated to the Riemannian structure, as well as its inverse, by utilizing past approaches which compute action minimizing curves in order to numerically approximate transport distances for measures supported on discrete spaces. Intrinsic gradient descent is then used to synthesize barycenters, wherein gradients of a variance functional are computed by approximating geodesic curves between the current iterate and the reference measures; iterates are then pushed forward via a discretization of the continuity equation. Analysis of measures with respect to given dictionary of references is performed by solving a quadratic program formed by computing geodesics between target and reference measures. We compare our novel approach to one based on entropic regularization of the static formulation of the optimal transport problem where the graph structure is encoded via graph distance functions, we present numerical experiments validating our approach, and we conclude that intrinsic gradient descent on the probability simplex provides a coherent framework for the synthesis and analysis of measures supported on graphs.
Read the full abstract ▾
Statistics Applications
The Load Management Paradox: Correcting the Healthy-Worker Survivor Effect in NBA Injury Modeling
Yue Yu and Guanyu Hu
In professional sports analytics, evaluating the relationship between accumulated workload and injury risk is a central objective. However, naive survival models applied to NBA game-log data consistently yield a paradox: players who recently logged heavy minutes appear less likely to sustain an injury. We demonstrate that this counterintuitive result is an artifact of the healthy-worker survivor effect, wherein conditioning on game participation induces severe
collider bias driven by unobserved latent fitness. To address this structural confounding, we develop a Marginal Structural Piecewise Exponential Model (MS-PEM) that unifies inverse probability of treatment weighting (IPTW) with flexible piecewise-exponential additive models and weighted cumulative exposure (WCE). A simulation study confirms that this selection mechanism is mathematically sufficient to entirely reverse the sign of the true association between workload and injury. Applying the MS-PEM to 78,594 player-game observations across three NBA seasons (encompassing 771 players and 2,439 injury events), we find that adjusting for observed selection reliably shifts the hazard back toward the underlying physiological relationship. While the exact magnitude of the correction is sensitive to outcome-model regularization (attenuating the paradoxical weight function by 1% to 2% under conservative cross-validation and up to 63% to 78% under lighter penalization), the positive direction of the causal correction is highly robust across multiple propensity specifications and doubly robust checks. Ultimately, these results provide a methodological template for bias-aware sports injury modeling, while cautioning that models relying strictly on observational game logs will systematically underestimate the true risk of heavy workloads without richer physiological data for full causal identification.
Read the full abstract ▾
Machine Learning (Statistics)
Koopman Operator Identification of Model Parameter Trajectories for Temporal Domain Generalization (KOMET)
Randy C. Hoover, Jacob James, Paul May et al. (+1 more)
Parametric models deployed in non-stationary environments degrade as the underlying data distribution evolves over time (a phenomenon known as temporal domain drift). In the current work, we present KOMET (Koopman Operator identification of Model parameter
Evolution under Temporal drift), a model-agnostic, data-driven framework that treats the sequence of trained parameter vectors as the trajectory of a nonlinear dynamical system and identifies its governing linear operator via Extended Dynamic Mode Decomposition (EDMD). A warm-start sequential training protocol enforces parameter-trajectory smoothness, and a
Fourier-augmented observable dictionary exploits the periodic structure inherent in many real-world distribution drifts. Once identified, KOMET's Koopman operator predicts future parameter trajectories autonomously, without access to future labeled data, enabling zero-retraining adaptation at deployment. Evaluated on six
datasets spanning rotating, oscillating, and expanding distribution geometries, KOMET achieves mean autonomous-rollout accuracies between 0.981 and 1.000 over 100 held-out time steps. Spectral and coupling analyses further reveal interpretable dynamical structure consistent with the geometry of the drifting decision boundary.
Read the full abstract ▾
All authors Randy C. Hoover, Jacob James, Paul May, Kyle Caudle
Statistical Methodology
A Bayesian Functional Concurrent Zero-Inflated Dirichlet-Multinomial Regression Model with Application to Infant Microbiome
Brody Erlandson, Ander Wilson and Matthew D. Koslovsky
The infant microbiome undergoes rapid changes in composition over time and is associated with long-term risks of conditions such as immune strength, allergy, asthma, and other health outcomes. Modeling the associations between exposures or treatments and microbial composition over time is essential for understanding the factors that drive these changes. Estimating these temporal dynamics has several challenges including: repeated measures, overdispersion, compositionality, high-dimensional parameter spaces, and zero-inflation. Many longitudinal regression models used in human microbiome research assume constant effects over time that cannot capture time-varying or functional effects of exposures, ignore the compositional structure of the data by modeling each taxon separately, and are not equipped to handle potential zero-inflation. Dirichlet-multinomial (DM) regression models inherently accommodate overdispersion and the compositional structure of the data and have been extended to account for excess zeros. However, existing DM-based regression models are unable to additionally handle repeated measures designs. To fill this gap, we propose a functional concurrent zero-inflated Dirichlet-multinomial (FunC-ZIDM) regression model which is designed to model time-varying relations between observed
covariates and microbial taxa while accounting for zero-inflation, compositionality, and repeated measures. Through simulation, we demonstrate that the model can accurately estimate the underlying functional relations and scale to large compositional spaces. We apply our model to investigate time-varying associations between infant microbiome composition and observed
covariates during the 11-week postnatal period. We found that $\alpha$-diversity (i.e., diversity of the microbiome within an individual) is positively associated with a higher gestational age and percentage of breast milk in the diet.
Read the full abstract ▾
Statistics Applications
Synthesizing the Counterfactual: A CTGAN-Augmented Causal Evaluation of Palliative Care on Spousal Depression
Pietro Grassi, Roberto Molinari, Chiara Seghieri et al. (+1 more)
Spousal bereavement severely deteriorates mental health. While palliative care benefits dying patients, its "stress-buffering" effect on survivors' depression remains empirically elusive due to acute small-$N$ constraints in longitudinal dyadic data. This study evaluates the causal impact of palliative care on bereaved spouses while introducing Synthetic Data Generation (SDG) to resolve sample attrition in quasi-experimental designs. Using SHARE panel data, we augment the sparse treated cohort via a Conditional Tabular GAN, anchoring synthetic trajectories to empirical baseline constraints to preserve causal pathways. A Matched Difference-in-Differences
estimator applied to the high-fidelity augmented
dataset evaluates the treatment effect. Results reveal a non-linear psychological response. Palliative care initially exacerbates acute depressive symptoms at the time of loss ($\beta_0 = 0.218,\ p < 0.05$), reflecting the intense emotional confrontation of the intervention. However, a sustained stress-buffering effect emerges in subsequent periods ($\beta_2 = -0.763,\ p < 0.01$), indicating an accelerated long-term recovery compared to standard care. Estimates are highly robust to unobserved confounding (Oster's $\delta > 1$). Substantively, we advocate for reconceptualizing end-of-life care as a dyadic public health intervention. Methodologically, we establish SDG as a robust analytical tool capable of powering fragile quasi-experiments in longitudinal social surveys.
Read the full abstract ▾
All authors Pietro Grassi, Roberto Molinari, Chiara Seghieri, Daniele Vignoli
Statistics Applications
Biased Mean Quadrangle and Applications
Anton Malandii and Stan Uryasev
This paper introduces biased mean regression, estimating the biased mean, i.e., $\mathbb{E}[Y] + x$, where $x \in \mathbb{R}$. The approach addresses a fundamental statistical problem that covers numerous applications. For instance, it can be used to estimate factors driving portfolio loss exceeding the expected loss by a specified amount (e.g., $ x=\$10 billion$) or to estimate factors impacting a specific excess release of radiation in the environment, where nuclear safety regulations specify different severity levels. The estimation is performed by minimizing the so-called \emph{superexpectation error}. We establish two equivalence results that connect the method to popular paradigms: (i) biased mean regression is equivalent to quantile regression for an appropriate parameterization and is equivalent to ordinary least squares when $x=0$; (ii) in portfolio optimization, minimizing superexpectation risk, associated with the superexpectation error, is equivalent to CVaR optimization. The approach is computationally attractive, as minimizing the superexpectation error reduces to linear programming (LP), thereby offering algorithmic and modeling advantages. It is also a good alternative to ordinary least squares (OLS) regression. The approach is based on the Risk Quadrangle (RQ) framework, which links four
stochastic functionals – error, regret, risk, and deviation – through a statistic. For the biased mean quadrangle, the statistic is the biased mean. We study properties of the new quadrangle, such as subregularity, and establish its relationship to the
quantile quadrangle. Numerical experiments confirm the theoretical statements and illustrate the practical implications.
Read the full abstract ▾
Statistics Applications
Statistical modeling of breast cancer radiomic features and hazard using image registration-aided longitudinal CT data
Subrata Mukherjee, Qian Cao, Thibaud Coroller et al. (+3 more)
Patients with metastatic breast cancer (mBC) undergo repeated computed
tomography (CT) imaging during treatment to monitor disease progression. Accurate longitudinal tracking of individual lesions across scans from multiple radiologists is essential for reliable radiomic analysis and clinical decision-making. We conducted a retrospective study using serial chest CT scans from the Phase III MONALEESA-3 and MONALEESA-7 trials and developed statistical models for multi-source data integration and survival analysis. First, we introduced a Registration-based Automated Matching and Correspondence (RAMAC)
algorithm to establish lesion correspondence across annotations from different radiologists and imaging time points using the Hungarian
algorithm. Second, using the RAMAC-processed
dataset, we developed interpretable radiomic survival models for progression-free survival prediction by combining baseline radiomic features, post-treatment changes at Weeks 8, 16, and 24, and demographic variables. To address the high dimensionality of longitudinal radiomic data, feature reduction was performed using an L1-penalized additive Cox proportional hazards model and best subset selection followed by Cox modeling. Model performance was evaluated using the concordance index (C-index). Incorporating additional imaging time points improved predictive performance, increasing the mean C-index from 0.58 at baseline to 0.64. Joint modeling further showed significant associations between longitudinal radiomic features and survival outcomes over time.
Read the full abstract ▾
All authors Subrata Mukherjee, Qian Cao, Thibaud Coroller, Ravi K. Samala, Nicholas Petrick, Berkman Sahiner
Statistical Methodology
The exact amount of t-ness that the normal model can tolerate
Nils Lid Hjort
Suppose that the normal model is used for data $Y_1,\ldots,Y_n$, but that the true distribution is a t-distribution with location and scale parameters $\xi$ and $\sigma$ and $m$ degrees of freedom. The normal model corresponds to $m=\infty$. Using a local asymptotic framework where $m$ is allowed to increase with $n$ two classes of estimands are identified. One small class, which in particular contains the functions of $\xi$ alone, is only affected by t-ness to the second order, and maximum likelihood estimation in the two- or three-parameter models become equivalent. For all other estimands it is shown that if $m\ge1.458\sqrt{n}$, then maximum likelihood estimation using the incorrect normal model is still more precise than using the correct three-parameter model. This is furthermore shown to be true in regression models with t-distributed residuals. We also propose and analyse compromise
estimators that in various ways interpolate between the normal and the nonnormal models. A separate section extends the t-ness results to general normal scale mixtures, in which case the tolerance radius around the normal error distribution takes the form of an upper bound $0.3429/\sqrt{n}$ for the variance of the scale mixture distribution. Proving our results requires somewhat nonstandard `corner asymptotics' since behaviour of
estimators must be studied when the crucial parameter $\gamma=1/m$ is close to zero, which is not an inner point of the parameter space, and the maximum likelihood
estimator of $m$ is equal to $\infty$ with positive probability.
Read the full abstract ▾
Machine Learning (Statistics) · Cross-listed from cs.LG
A Hierarchical Sheaf Spectral Embedding Framework for Single-Cell RNA-seq Analysis
Xiang Xiang Wang and Guo-Wei We
Single-
cell RNA-seq data analysis typically requires representations that capture heterogeneous local structure across multiple scales while remaining stable and interpretable. In this work, we propose a hierarchical sheaf spectral
embedding (HSSE) framework that constructs informative
cell-level features based on persistent sheaf
Laplacian analysis. Starting from scale-dependent low-dimensional
embeddings, we define
cell-centered local neighborhoods at multiple resolutions. For each local neighborhood, we construct a data-driven cellular sheaf that encodes local relationships among
cells. We then compute persistent sheaf
Laplacians over sampled filtration intervals and extract spectral statistics that summarize the
evolution of local relational structure across scales. These spectral descriptors are aggregated into a unified feature vector for each
cell and can be directly used in downstream learning tasks without additional model training. We evaluate HSSE on twelve
benchmark single-
cell RNA-seq
datasets covering diverse biological systems and data scales. Under a consistent classification protocol, HSSE achieves competitive or improved performance compared with existing multiscale and classical
embedding-based methods across multiple evaluation metrics. The results demonstrate that sheaf spectral representations provide a robust and interpretable approach for single-
cell RNA-seq data representation learning.
Read the full abstract ▾
Statistics Theory
Estimation of projection operators with Gaussian noise
Luca Castelli
This paper focuses on random projection operators when the subspace of projection is estimated. We derive non-asymptotic upper bounds on the error between the projection onto the estimated subspace and the projection onto the underlying subspace. The provided upper bounds depend on the noise and on intrinsic properties of the estimated subspace. Several scenarios are considered according to the distribution of the
estimator of the
matrix spanning the subspace. The aforementioned bounds are attained under a structural assumption on the Gram
matrix associated with the subspace. Regularized
estimators are introduced to circumvent this assumption. An example is given in the partial least square (PLS) framework where the estimated subspace is spanned by the PLS weights.
Read the full abstract ▾
Statistical Methodology · Cross-listed from cs.LG
Automatic Laplace Collapsed Sampling: Scalable Marginalisation of Latent Parameters via Automatic Differentiation
Toby Lovick, David Yallup and Will Handley
We present Automatic Laplace Collapsed Sampling (ALCS), a general framework for marginalising latent parameters in
Bayesian models using automatic differentiation, which we combine with nested sampling to explore the hyperparameter space in a robust and efficient manner. At each nested sampling likelihood evaluation, ALCS collapses the high-dimensional latent variables $z$ to a scalar contribution via maximum a posteriori (MAP) optimisation and a Laplace approximation, both computed using autodiff. This reduces the effective dimension from $d_\theta + d_z$ to just $d_\theta$, making
Bayesian evidence computation tractable for high-dimensional settings without hand-derived gradients or Hessians, and with minimal model-specific engineering. The MAP optimisation and Hessian evaluation are parallelised across live points on GPU-hardware, making the method practical at scale. We also show that automatic differentiation enables local approximations beyond Laplace to parametric families such as the Student-$t$, which improves evidence estimates for heavy-tailed latents. We validate ALCS on a suite of
benchmarks spanning hierarchical, time-series, and discrete-likelihood models and establish where the Gaussian approximation holds. This enables a post-hoc ESS diagnostic that localises failures across hyperparameter space without expensive joint sampling.
Read the full abstract ▾
Statistics Theory
Statistical inference for extremal directions in high-dimensional spaces
Lucas Butsch and Vicky Fasen-Hartmann
In multivariate extreme value statistics, the first step in understanding the dependence structure of extremes is identifying the directions in which they occur. The novelty of this paper is the analysis of high-dimensional extreme value models in which both the model dimension and the number of bias directions go to infinity as the number of observations tends to infinity; we estimate the number of extremal directions. To address the curse of dimensionality, we extend and investigate the information criteria (AIC, BICU, BICL, QAIC and MSEIC) from the fixed-dimensional case (Butsch and Fasen-Hartmann, 2025a; Meyer and Wintenberger, 2023), which employ the concept of sparse regular variation that is closely related to multivariate regular variation, for the estimation of the number of extremal directions. For all information criteria, we derive sufficient conditions for consistency. Unlike in the fixed-dimensional case, where only the
Bayesian information criteria (BICU and BICL) and the QAIC are consistent, the AIC and MSEIC are also consistent in high dimensions under certain model assumptions. We compare the performance of the different information criteria in a simulation study that includes a detailed analysis of the model assumptions and the necessary and sufficient conditions for consistency.
Read the full abstract ▾
Statistical Methodology · Cross-listed from cs.LG
Benchmarking Tabular Foundation Models for Conditional Density Estimation in Regression
Rafael Izbicki and Pedro L. C. Rodrigues
Conditional density estimation (CDE) - recovering the full conditional distribution of a response given tabular
covariates - is essential in settings with heteroscedasticity, multimodality, or asymmetric uncertainty. Recent tabular foundation models, such as TabPFN and TabICL, naturally produce predictive distributions, but their effectiveness as general-purpose CDE methods has not been systematically evaluated, unlike their performance for point prediction, which is well studied. We
benchmark three tabular foundation model variants against a diverse set of parametric, tree-based, and neural CDE baselines on 39 real-world
datasets, across training sizes from 50 to 20,000, using six metrics covering density accuracy, calibration, and computation time. Across all sample sizes, foundation models achieve the best CDE loss, log-likelihood, and CRPS on the large majority of
datasets tested. Calibration is competitive at small sample sizes but, for some metrics and
datasets, lags behind task-specific neural baselines at larger sample sizes, suggesting that post-hoc recalibration may be a valuable complement. In a photometric
redshift case study using SDSS DR18, TabPFN exposed to 50,000 training
galaxies outperforms all baselines trained on the full 500,000-
galaxy dataset. Taken together, these results establish tabular foundation models as strong off-the-shelf conditional density
estimators.
Read the full abstract ▾
Machine Learning (Statistics) · Cross-listed from cs.LG
Sharp Capacity Scaling of Spectral Optimizers in Learning Associative Memory
Juno Kim, Eshaan Nichani, Denny Wu et al. (+2 more)
Spectral optimizers such as
Muon have recently shown strong empirical performance in large-scale
language model training, but the source and extent of their advantage remain poorly understood. We study this question through the linear associative
memory problem, a tractable model for factual recall in
transformer-based models. In particular, we go beyond orthogonal
embeddings and consider Gaussian inputs and outputs, which allows the number of stored associations to greatly exceed the
embedding dimension. Our main result sharply characterizes the recovery rates of one step of
Muon, SGD, and Newton's method on the logistic regression loss under a power law frequency distribution. We show that the storage capacity of
Muon significantly exceeds that of SGD, and even matches Newton's method while only using first-order information. Moreover,
Muon saturates at a larger critical batch size. We further analyze the multi-step dynamics under a thresholded gradient approximation and show that
Muon achieves a substantially faster initial recovery rate than SGD, while both methods eventually converge to the information-theoretic limit at comparable speeds. Experiments on synthetic tasks validate the predicted scaling laws. Our analysis provides a quantitative understanding of the signal amplification of spectral preconditioners and lays the groundwork for establishing scaling laws across more practical
language modeling tasks and optimizers.
Read the full abstract ▾
All authors Juno Kim, Eshaan Nichani, Denny Wu, Alberto Bietti, Jason D. Lee
Statistics Applications
Impact of Residential Retrofits on Gas and Electricity Consumption in France
Charly Andral, Laetitia Leduc, Guillaume Matheron et al. (+1 more)
This study examines the impact of residential energy retrofits on household energy consumption in France using smart meter data from nearly 2,500 Hello Watt users, using a two-period difference-in-differences design. The
dataset combines daily electricity and gas consumption collected through smart meters, hourly temperatures from Météo France, and user-declared home and retrofit information. As a control, we use a group composed of homes of Hello Watt users that are similar to the treated homes, but did not undergo any renovations. The average treatment effect on the treated is estimated with the
estimator of Sant'Anna & Zhao (2020). Estimates are reported by energy source (electricity vs. gas) and by retrofit type. The retrofit measures considered are limited to single interventions: wall insulation, attic insulation, floor insulation, installation of an air-to-air heat pump, or installation of an air-to-water heat pump. A comprehensive retrofit is defined separately as the simultaneous implementation of at least two of these measures. Our results show that insulation works cause a significant decrease in both electricity and gas consumption (3% to 13% and 5% to 16% respectively, depending on the retrofit type). We also estimate the reduction on the heating consumption only (7% to 27% for electrical heating and 7% to 19% for gas heating). We also study retrofits that consist in replacing a gas boiler with an air-to-water heat pump, resulting in a cut of 85% in carbon emissions.
Read the full abstract ▾
All authors Charly Andral, Laetitia Leduc, Guillaume Matheron, Yukihide Nakada
Statistical Methodology
Targeted learning of heterogeneous treatment effect curves for right censored or left truncated time-to-event data
Matthew Pryce, Karla Diaz-Ordaz, Ruth H. Keogh et al. (+1 more)
In recent years, there has been growing interest in causal machine learning
estimators for quantifying subject-specific effects of a binary treatment on time-to-event outcomes. Estimation approaches have been proposed which attenuate the inherent regularisation bias in machine learning predictions, with each of these
estimators addressing measured confounding, right censoring, and in some cases, left truncation. However, the existing approaches are found to exhibit suboptimal finite-sample performance, with none of the existing
estimators fully leveraging the temporal structure of the data, yielding non-smooth treatment effects over time. We address these limitations by introducing surv-iTMLE, a targeted learning procedure for estimating the difference in the conditional survival probabilities under two treatments. Unlike existing
estimators, surv-iTMLE accommodates both left truncation and right censoring while enforcing smoothness and boundedness of the estimated treatment effect curve over time. Through extensive simulation studies under both right censoring and left truncation scenarios, we demonstrate that surv-iTMLE outperforms existing methods in terms of bias and smoothness of time-varying effect estimates in finite samples. We then illustrate surv-iTMLE's practical utility by exploring heterogeneity in the effects of immunotherapy on survival among non-small
cell lung cancer (NSCLC) patients, revealing clinically meaningful temporal patterns that existing
estimators may obscure.
Read the full abstract ▾
All authors Matthew Pryce, Karla Diaz-Ordaz, Ruth H. Keogh, Stijn Vansteelandt
Statistical Methodology · Cross-listed from cs.SD
Probabilistic Multilabel Graphical Modelling of Motif Transformations in Symbolic Music
Ron Taieb, Yoel Greenberg and Barak Sober
Motifs often recur in musical works in altered forms, preserving aspects of their identity while undergoing local variation. This paper investigates how such motivic transformations occur within their musical context in symbolic music. To support this analysis, we develop a probabilistic framework for modeling motivic transformations and apply it to Beethoven's piano sonatas by integrating multiple
datasets that provide melodic, rhythmic, harmonic, and motivic information within a unified analytical representation. Motif transformations are represented as multilabel variables by comparing each motif instance to a designated reference occurrence within its local context, ensuring consistent labeling across transformation families. We introduce a multilabel Conditional Random Field to model how motif-level musical features influence the occurrence of transformations and how different transformation families tend to co-occur. Our goal is to provide an interpretable, distributional analysis of motivic transformation patterns, enabling the study of their structural relationships and stylistic variation. By linking computational modeling with music-theoretical interpretation, the proposed framework supports quantitative investigation of musical structure and complexity in symbolic corpora and may facilitate the analysis of broader compositional patterns and writing practices.
Read the full abstract ▾
Statistics Theory
The relative value of interventional and observational samples in Bayesian Causal Linear Gaussian Models
Valentinian Lungu, Anish Dhir, Mark van der Wilk et al. (+1 more)
We investigate the asymptotic properties of
Bayesian bivariate causal discovery for Gaussian Linear Structural Equation Models (SEMs) with heteroscedastic noise. We demonstrate that with purely observational data, the posterior distribution over the models fails to consistently identify the true causal structure - a consequence of the fundamental non-identifiability within the Markov Equivalence Class. Specifically, if the true generating mechanism corresponds to a connected graph (A -> B or B -> A), the asymptotic behavior of the posterior is given by the ratio between the prior on the true model and the push-forward prior of the alternative. In contrast, for the independence model, we establish that the posterior concentrates at a
stochastic polynomial rate of O_p(n^{-1/2}). To resolve this non-identifiability, we incorporate m interventional samples and characterize the concentration rates as a function of the observational-to-total sample ratio, \eta. We identify a sharp concentration dichotomy: while the independence graph maintains a
polynomial O_p(N^{-1/2}) rate (where N = n+m), connected graphs undergo a phase transition to exponentially fast convergence. This highlights an exponential relative importance between the two data types, as altering the amount of one data type directly changes the exponent governing the concentration speed. We derive explicit formulae for the exponential decay rates and provide precise conditions under which mixing observational and interventional data optimizes concentration speed. Finally, our theoretical findings are validated through empirical simulations in
Bayesian Gaussian equivalent (BGe)-style prior specifications offering a principled foundation for experimental design in
Bayesian causal discovery.
Read the full abstract ▾
All authors Valentinian Lungu, Anish Dhir, Mark van der Wilk, Ioannis Kontoyiannis
Machine Learning (Statistics)
Kantorovich–Kernel Neural Operators: Approximation Theory, Asymptotics, and Neural Network Interpretation
Tian-Xiao He
This paper studies a class of multivariate Kantorovich-kernel neural network operators, including the deep Kantorovich-type neural network operators studied by Sharma and Singh. We prove density results, establish quantitative convergence estimates, derive Voronovskaya-type
theorems, analyze the limits of partial differential equations for deep composite operators, prove Korovkin-type
theorems, and propose inversion
theorems. This paper studies a class of multivariate Kantorovich-kernel neural network operators, including the deep Kantorovich-type neural network operators studied by Sharma and Singh. We prove density results, establish quantitative convergence estimates, derive Voronovskaya-type
theorems, analyze the limits of partial differential equations for deep composite operators, prove Korovkin-type
theorems, and propose inversion
theorems. Furthermore, this paper discusses the connection between neural network architectures and the classical positive operators proposed by Chui, Hsu, He, Lorentz, and Korovkin.
Read the full abstract ▾
Statistics Applications · Cross-listed from cs.LG
KMM-CP: Practical Conformal Prediction under Covariate Shift via Selective Kernel Mean Matching
Siddhartha Laghuvarapu, Rohan Deb and Jimeng Sun
Uncertainty quantification is essential for deploying machine learning models in high-stakes domains such as scientific discovery and healthcare. Conformal Prediction (CP) provides finite-sample coverage guarantees under exchangeability, an assumption often violated in practice due to distribution shift. Under
covariate shift, restoring validity requires importance weighting, yet accurate density-ratio estimation becomes unstable when training and test distributions exhibit limited support overlap. We propose KMM-CP, a conformal prediction framework based on Kernel Mean Matching (KMM) for
covariate-shift correction. We show that KMM directly controls the bias-variance components governing conformal coverage error by minimizing RKHS moment discrepancy under explicit weight constraints, and establish asymptotic coverage guarantees under mild conditions. We then introduce a selective extension that identifies regions of reliable support overlap and restricts conformal correction to this subset, further improving stability in low-overlap regimes. Experiments on molecular property prediction
benchmarks with realistic distribution shifts show that KMM-CP reduces coverage gap by over 50% compared to existing approaches. The code is available at https://github.com/siddharthal/KMM-CP.
Read the full abstract ▾
Statistics Applications
Summarising mortality data with a time-dependent beta latent variable model
Pedro Menezes de Araújo, Isobel Claire Gormley and Thomas Brendan Murphy
Age-specific probabilities of death provide a snapshot of population mortality at the country level at a given point in time. Due to the high dimensionality of the data, summarising mortality information is essential for various analyses, such as visualisation and clustering. We propose the use of beta latent variable (BLV) models to summarise mortality information without data transformation. A time-dependent version of the BLV model is developed by incorporating an autoregressive prior for the latent effects. This model aims to represent mortality data with a small set of $K$ latent effects while accounting for time dependence between these effects. Inference is performed using
Bayesian methods, with posterior samples generated via
Hamiltonian Monte Carlo. The BLV model is applied to probabilities of death from the Human Mortality Database, covering 41 countries and 23 age-specific probabilities of death over several periods. The time-dependent BLV model with $K=6$ latent effects accurately reconstructs observed mortality data, and the model parameters have intuitive and insightful interpretations. The time-dependent BLV outperforms the standard Gaussian factor analysis model applied to logit probability of death, and demonstrates that BLV models can effectively summarise mortality data.
Read the full abstract ▾
Statistics Theory
Validating spatial-temporal separability for stationary processes
Lujia Bai, Holger Dette and Zihao Yuan
A crucial assumption to reduce computational complexity in spatial-temporal data analysis is separability, which factors the covariance structure into a purely spatial and a purely temporal component. In this paper, we develop statistical inference tools for validating this assumption for a second-order stationary process under both domain-expanding-infill asymptotics and domain-expanding asymptotics. In contrast to previous work on this subject, the methodology neither requires the assumption of normally distributed data, nor uses spectral methods. Our approach is based on nonparametric estimates of measures for the deviation between the covariance
matrix and separable approximations, which vanish if and only if the assumption of separability is satisfied. We derive the asymptotic distributions of appropriate
estimators for these measures with non-standard limiting distributions and use these results to develop inference tools for validating the assumption of separability. More specifically, we derive confidence intervals for the deviation measures, tests for the hypothesis of exact separability, and for the hypothesis that the deviation from separability is smaller than a prespecified threshold.
Read the full abstract ▾
Statistical Methodology
Mixed Time Series Quasi-Likelihood Models for Uncovering Covid-19 Viral Load and Mortality Dynamics
Kejin Wu, Raanju R. Sundararajan, Michel F.C. Haddad et al. (+2 more)
Accurate real-time monitoring of disease transmission is crucial for epidemic control, which has conventionally relied on reported cases or hospital admissions. Such metrics are frequently susceptible to delays in reporting, various forms of bias, and under-ascertainment. Cycle threshold values obtained from reverse transcription quantitative polymerase chain reaction offer a promising alternative, serving as a proxy for viral load. In this paper, we aim to jointly model the viral load and the number of deaths (mortality), which involves a continuous bounded and a count time series, and therefore, a proper mixed-type model is needed. This is the motivation to introduce a new mixed-valued time series quasi-likelihood (MixTSQL) model capable of analyzing multivariate time series of different types, like continuous, discrete, bounded, and continuous positive. The MixTSQL model only requires a mean-variance specification with no distributional assumptions needed, and allows for testing Granger causality. Statistical guarantees are provided to ensure consistency and asymptotic normality of the proposed quasi-maximum likelihood
estimators. We analyze weekly viral load and Covid-19 death counts in São Paulo, Brazil, using our MixTSQL model, which not only establishes the temporal order in which viral load Granger-causes mortality but also offers a comprehensive joint statistical analysis.
Read the full abstract ▾
All authors Kejin Wu, Raanju R. Sundararajan, Michel F.C. Haddad, Luiza S.C. Piancastelli, Wagner Barreto-Souza
Machine Learning (Statistics)
Generative Score Inference for Multimodal Data
Xinyu Tian and Xiaotong Shen
Accurate uncertainty quantification is crucial for making reliable decisions in various supervised learning scenarios, particularly when dealing with complex,
multimodal data such as images and text. Current approaches often face notable limitations, including rigid assumptions and limited generalizability, constraining their effectiveness across diverse supervised learning tasks. To overcome these limitations, we introduce Generative Score Inference (GSI), a flexible inference framework capable of constructing statistically valid and informative prediction and confidence sets across a wide range of
multimodal learning problems. GSI utilizes synthetic samples generated by deep generative models to approximate conditional score distributions, facilitating precise uncertainty quantification without imposing restrictive assumptions about the data or tasks. We empirically validate GSI's capabilities through two representative scenarios:
hallucination detection in large
language models and uncertainty estimation in image captioning. Our method achieves state-of-the-art performance in
hallucination detection and robust predictive uncertainty in image captioning, and its performance is positively influenced by the quality of the underlying generative model. These findings underscore the potential of GSI as a versatile inference framework, significantly enhancing uncertainty quantification and trustworthiness in
multimodal learning.
Read the full abstract ▾
Machine Learning (Statistics)
A Power-Weighted Noncentral Complex Gaussian Distribution
Toru Nakashika
The complex Gaussian distribution has been widely used as a fundamental spectral and noise model in signal processing and communication. However, its Gaussian structure often limits its ability to represent the diverse amplitude characteristics observed in individual source signals. On the other hand, many existing non-Gaussian amplitude distributions derived from hyperspherical models achieve good empirical fit due to their power-law structures, while they do not explicitly account for the complex-plane geometry inherent in complex-valued observations. In this paper, we propose a new probabilistic model for complex-valued random variables, which can be interpreted as a power-weighted noncentral complex Gaussian distribution. Unlike conventional hyperspherical amplitude models, the proposed model is formulated directly on the complex plane and preserves the
geometric structure of complex-valued observations while retaining a higher-dimensional interpretation. The model introduces a nonlinear phase
diffusion through a single shape parameter, enabling continuous control of the distributional geometry from arc-shaped
diffusion along the phase direction to concentration of probability mass toward the origin. We formulate the proposed distribution and analyze the statistical properties of the induced amplitude distribution. The derived amplitude and power distributions provide a unified framework encompassing several widely used distributions in signal modeling, including the Rice, Nakagami, and gamma distributions. Experimental results on
speech power spectra demonstrate that the proposed model consistently outperforms conventional distributions in terms of log-likelihood.
Read the full abstract ▾
Statistics Applications
Bayesian estimation of optical constants using mixtures of Gaussian process experts
Teemu Härkönen, Hui Chen and Erik Vartiainen
We propose modeling absorption spectrum measurements as mixtures of Gaussian process experts. This enables us to construct a flexible statistical model for interpolating and extrapolating measurements, facilitating statistical integration of Kramers-Kronig relations to estimate the whole complex refractive index. Additionally, we statistically model the anchoring points used in subtractive Kramers-Kronig relations to account for possible measurement errors of the anchor point. In addition to flexible statistical modeling, the mixtures of Gaussian process formulation enables automatic selection of measurement points to use for extrapolation. We apply the method to experimental absorption spectrum measurements of gallium arsenide, potassium chloride, and transparent wood.
Read the full abstract ▾
Statistical Methodology
Making Multi-Axis Models Robust to Multiplicative Noise: How, and Why?
Bailey Andrew, David R. Westhead and Luisa Cutillo
In this paper we develop a graph-learning
algorithm, MED-MAGMA, to fit multi-axis (Kronecker-sum-structured) models corrupted by multiplicative noise. This type of noise is natural in many application domains, such as that of single-
cell RNA sequencing, in which it naturally captures technical biases of RNA sequencing platforms. Our work is evaluated against prior work on each and every public
dataset in the Single
Cell Expression Atlas under a certain size, demonstrating that our methodology learns networks with better local and global structure. MED-MAGMA is made available as a Python package (MED-MAGMA).
Read the full abstract ▾