Peer Revenue Play credits. Real papers.

Papers

Fresh from arXiv, typeset properly. Highlighted words trade on the market.

Statistics

stat Watch Statistics (sign in to use)

Friday 27 March

Machine Learning (Statistics) · Cross-listed from cs.CR

On the Optimal Number of Grids for Differentially Private Non-Interactive $K$-Means Clustering

Differentially private $K$-means clustering enables releasing cluster centers derived from a dataset while protecting the privacy of the individuals. Non-interactive clustering techniques based on privatized histograms are attractive because the released data synopsis can be reused for other downstream tasks without additional privacy loss. The choice of the number of grids for discretizing the data points is crucial, as it directly controls the quantization bias and the amount of noise injected to preserve privacy. The widely adopted strategy selects a grid size that is independent of the number of clusters and also relies on empirical tuning. In this work, we revisit this choice and propose a refined grid-size selection rule derived by minimizing an upper bound on the expected deviation in the K-means objective function, leading to a more principled discretization strategy for non-interactive private clustering. Compared to prior work, our grid resolution differs both in its dependence on the number of clusters and in the scaling with dataset size and privacy budget. Extensive numerical results elucidate that the proposed strategy results in accurate clustering compared to the state-of-the-art techniques, even under tight privacy budgets.
Read the full abstract

Statistical Methodology

Adaptive procedures for boundary FDR control

A cornerstone of the multiple testing literature is the Benjamini-Hochberg (BH) procedure, which guarantees control of the FDR when $p$-values are independent or positively dependent. While BH controls the average quality of rejections, it does not provide guarantees for individual discoveries, particularly those near the rejection threshold, which are more likely to be false than the average rejection. For independent $p$-values with Uniform$(0,1)$ null distribution, the Support Line procedure (SL; arXiv:2207.07299) provably controls the error probability for the rejection at the edge of the discovery set (i.e. the one with largest $p$-value) at level $q m_0/m$, where $m_0$ is the number of true null hypotheses and $q$ is a tuning parameter. In this work, we study adaptive versions of the SL procedure that operate in two steps: the first step estimates $m_0$ from non-significant statistics, and the second step runs the SL procedure at an adjusted level $q m / \hat{m}_0$. The adaptive procedures are shown to control the false discovery probability for the "boundary” rejection under an independence assumption. Simulation studies suggest that some but not all of the two-stage procedures maintain error control under positive dependence, and that substantial power is gained relative to the original SL procedure. We illustrate differences between the procedures on meta-data from the recent literature in behavioral psychology on growth mindset and nudge interventions.
Read the full abstract

Statistics Theory · Cross-listed from cs.LG

High dimensional theory of two-phase optimizers

The trend towards larger training setups has brought a renewed interest in partially asynchronous two-phase optimizers which optimize locally and then synchronize across workers. Additionally, recent work suggests that the one-worker version of one of these algorithms, DiLoCo, shows promising results as a (synchronous) optimizer. Motivated by these studies we present an analysis of LA-DiLoCo, a simple member of the DiLoCo family, on a high-dimensional linear regression problem. We show that the one-worker variant, LA, provides a different tradeoff between signal and noise than SGD, which is beneficial in many scenarios. We also show that the multi-worker version generates more noise than the single worker version, but that this additional noise generation can be ameliorated by appropriate choice of hyperparameters. We conclude with an analysis of SLA – LA with momentum – and show that stacking two momentum operators gives an opportunity for acceleration via a non-linear transformation of the "effective” Hessian spectrum, which is maximized for Nesterov momentum. Altogether our results show that two-phase optimizers represent a fruitful new paradigm for understanding and improving training algorithms.
Read the full abstract

Machine Learning (Statistics)

Static and Dynamic Approaches to Computing Barycenters of Probability Measures on Graphs

The optimal transportation problem defines a geometry of probability measures which leads to a definition for weighted averages (barycenters) of measures, finding application in the machine learning and computer vision communities as a signal processing tool. Here, we implement a barycentric coding model for measures which are supported on a graph, a context in which the classical optimal transport geometry becomes degenerate, by leveraging a Riemannian structure on the simplex induced by a dynamic formulation of the optimal transport problem. We approximate the exponential mapping associated to the Riemannian structure, as well as its inverse, by utilizing past approaches which compute action minimizing curves in order to numerically approximate transport distances for measures supported on discrete spaces. Intrinsic gradient descent is then used to synthesize barycenters, wherein gradients of a variance functional are computed by approximating geodesic curves between the current iterate and the reference measures; iterates are then pushed forward via a discretization of the continuity equation. Analysis of measures with respect to given dictionary of references is performed by solving a quadratic program formed by computing geodesics between target and reference measures. We compare our novel approach to one based on entropic regularization of the static formulation of the optimal transport problem where the graph structure is encoded via graph distance functions, we present numerical experiments validating our approach, and we conclude that intrinsic gradient descent on the probability simplex provides a coherent framework for the synthesis and analysis of measures supported on graphs.
Read the full abstract

Statistics Applications

The Load Management Paradox: Correcting the Healthy-Worker Survivor Effect in NBA Injury Modeling

In professional sports analytics, evaluating the relationship between accumulated workload and injury risk is a central objective. However, naive survival models applied to NBA game-log data consistently yield a paradox: players who recently logged heavy minutes appear less likely to sustain an injury. We demonstrate that this counterintuitive result is an artifact of the healthy-worker survivor effect, wherein conditioning on game participation induces severe collider bias driven by unobserved latent fitness. To address this structural confounding, we develop a Marginal Structural Piecewise Exponential Model (MS-PEM) that unifies inverse probability of treatment weighting (IPTW) with flexible piecewise-exponential additive models and weighted cumulative exposure (WCE). A simulation study confirms that this selection mechanism is mathematically sufficient to entirely reverse the sign of the true association between workload and injury. Applying the MS-PEM to 78,594 player-game observations across three NBA seasons (encompassing 771 players and 2,439 injury events), we find that adjusting for observed selection reliably shifts the hazard back toward the underlying physiological relationship. While the exact magnitude of the correction is sensitive to outcome-model regularization (attenuating the paradoxical weight function by 1% to 2% under conservative cross-validation and up to 63% to 78% under lighter penalization), the positive direction of the causal correction is highly robust across multiple propensity specifications and doubly robust checks. Ultimately, these results provide a methodological template for bias-aware sports injury modeling, while cautioning that models relying strictly on observational game logs will systematically underestimate the true risk of heavy workloads without richer physiological data for full causal identification.
Read the full abstract

Machine Learning (Statistics)

Koopman Operator Identification of Model Parameter Trajectories for Temporal Domain Generalization (KOMET)

Parametric models deployed in non-stationary environments degrade as the underlying data distribution evolves over time (a phenomenon known as temporal domain drift). In the current work, we present KOMET (Koopman Operator identification of Model parameter Evolution under Temporal drift), a model-agnostic, data-driven framework that treats the sequence of trained parameter vectors as the trajectory of a nonlinear dynamical system and identifies its governing linear operator via Extended Dynamic Mode Decomposition (EDMD). A warm-start sequential training protocol enforces parameter-trajectory smoothness, and a Fourier-augmented observable dictionary exploits the periodic structure inherent in many real-world distribution drifts. Once identified, KOMET's Koopman operator predicts future parameter trajectories autonomously, without access to future labeled data, enabling zero-retraining adaptation at deployment. Evaluated on six datasets spanning rotating, oscillating, and expanding distribution geometries, KOMET achieves mean autonomous-rollout accuracies between 0.981 and 1.000 over 100 held-out time steps. Spectral and coupling analyses further reveal interpretable dynamical structure consistent with the geometry of the drifting decision boundary.
Read the full abstract

All authors Randy C. Hoover, Jacob James, Paul May, Kyle Caudle

Statistical Methodology

A Bayesian Functional Concurrent Zero-Inflated Dirichlet-Multinomial Regression Model with Application to Infant Microbiome

The infant microbiome undergoes rapid changes in composition over time and is associated with long-term risks of conditions such as immune strength, allergy, asthma, and other health outcomes. Modeling the associations between exposures or treatments and microbial composition over time is essential for understanding the factors that drive these changes. Estimating these temporal dynamics has several challenges including: repeated measures, overdispersion, compositionality, high-dimensional parameter spaces, and zero-inflation. Many longitudinal regression models used in human microbiome research assume constant effects over time that cannot capture time-varying or functional effects of exposures, ignore the compositional structure of the data by modeling each taxon separately, and are not equipped to handle potential zero-inflation. Dirichlet-multinomial (DM) regression models inherently accommodate overdispersion and the compositional structure of the data and have been extended to account for excess zeros. However, existing DM-based regression models are unable to additionally handle repeated measures designs. To fill this gap, we propose a functional concurrent zero-inflated Dirichlet-multinomial (FunC-ZIDM) regression model which is designed to model time-varying relations between observed covariates and microbial taxa while accounting for zero-inflation, compositionality, and repeated measures. Through simulation, we demonstrate that the model can accurately estimate the underlying functional relations and scale to large compositional spaces. We apply our model to investigate time-varying associations between infant microbiome composition and observed covariates during the 11-week postnatal period. We found that $\alpha$-diversity (i.e., diversity of the microbiome within an individual) is positively associated with a higher gestational age and percentage of breast milk in the diet.
Read the full abstract

Statistics Applications

Synthesizing the Counterfactual: A CTGAN-Augmented Causal Evaluation of Palliative Care on Spousal Depression

Spousal bereavement severely deteriorates mental health. While palliative care benefits dying patients, its "stress-buffering" effect on survivors' depression remains empirically elusive due to acute small-$N$ constraints in longitudinal dyadic data. This study evaluates the causal impact of palliative care on bereaved spouses while introducing Synthetic Data Generation (SDG) to resolve sample attrition in quasi-experimental designs. Using SHARE panel data, we augment the sparse treated cohort via a Conditional Tabular GAN, anchoring synthetic trajectories to empirical baseline constraints to preserve causal pathways. A Matched Difference-in-Differences estimator applied to the high-fidelity augmented dataset evaluates the treatment effect. Results reveal a non-linear psychological response. Palliative care initially exacerbates acute depressive symptoms at the time of loss ($\beta_0 = 0.218,\ p < 0.05$), reflecting the intense emotional confrontation of the intervention. However, a sustained stress-buffering effect emerges in subsequent periods ($\beta_2 = -0.763,\ p < 0.01$), indicating an accelerated long-term recovery compared to standard care. Estimates are highly robust to unobserved confounding (Oster's $\delta > 1$). Substantively, we advocate for reconceptualizing end-of-life care as a dyadic public health intervention. Methodologically, we establish SDG as a robust analytical tool capable of powering fragile quasi-experiments in longitudinal social surveys.
Read the full abstract

All authors Pietro Grassi, Roberto Molinari, Chiara Seghieri, Daniele Vignoli

Statistics Applications

Biased Mean Quadrangle and Applications

This paper introduces biased mean regression, estimating the biased mean, i.e., $\mathbb{E}[Y] + x$, where $x \in \mathbb{R}$. The approach addresses a fundamental statistical problem that covers numerous applications. For instance, it can be used to estimate factors driving portfolio loss exceeding the expected loss by a specified amount (e.g., $ x=\$10 billion$) or to estimate factors impacting a specific excess release of radiation in the environment, where nuclear safety regulations specify different severity levels. The estimation is performed by minimizing the so-called \emph{superexpectation error}. We establish two equivalence results that connect the method to popular paradigms: (i) biased mean regression is equivalent to quantile regression for an appropriate parameterization and is equivalent to ordinary least squares when $x=0$; (ii) in portfolio optimization, minimizing superexpectation risk, associated with the superexpectation error, is equivalent to CVaR optimization. The approach is computationally attractive, as minimizing the superexpectation error reduces to linear programming (LP), thereby offering algorithmic and modeling advantages. It is also a good alternative to ordinary least squares (OLS) regression. The approach is based on the Risk Quadrangle (RQ) framework, which links four stochastic functionals – error, regret, risk, and deviation – through a statistic. For the biased mean quadrangle, the statistic is the biased mean. We study properties of the new quadrangle, such as subregularity, and establish its relationship to the quantile quadrangle. Numerical experiments confirm the theoretical statements and illustrate the practical implications.
Read the full abstract

Statistics Applications

Statistical modeling of breast cancer radiomic features and hazard using image registration-aided longitudinal CT data

Patients with metastatic breast cancer (mBC) undergo repeated computed tomography (CT) imaging during treatment to monitor disease progression. Accurate longitudinal tracking of individual lesions across scans from multiple radiologists is essential for reliable radiomic analysis and clinical decision-making. We conducted a retrospective study using serial chest CT scans from the Phase III MONALEESA-3 and MONALEESA-7 trials and developed statistical models for multi-source data integration and survival analysis. First, we introduced a Registration-based Automated Matching and Correspondence (RAMAC) algorithm to establish lesion correspondence across annotations from different radiologists and imaging time points using the Hungarian algorithm. Second, using the RAMAC-processed dataset, we developed interpretable radiomic survival models for progression-free survival prediction by combining baseline radiomic features, post-treatment changes at Weeks 8, 16, and 24, and demographic variables. To address the high dimensionality of longitudinal radiomic data, feature reduction was performed using an L1-penalized additive Cox proportional hazards model and best subset selection followed by Cox modeling. Model performance was evaluated using the concordance index (C-index). Incorporating additional imaging time points improved predictive performance, increasing the mean C-index from 0.58 at baseline to 0.64. Joint modeling further showed significant associations between longitudinal radiomic features and survival outcomes over time.
Read the full abstract

All authors Subrata Mukherjee, Qian Cao, Thibaud Coroller, Ravi K. Samala, Nicholas Petrick, Berkman Sahiner

Statistical Methodology

The exact amount of t-ness that the normal model can tolerate

Suppose that the normal model is used for data $Y_1,\ldots,Y_n$, but that the true distribution is a t-distribution with location and scale parameters $\xi$ and $\sigma$ and $m$ degrees of freedom. The normal model corresponds to $m=\infty$. Using a local asymptotic framework where $m$ is allowed to increase with $n$ two classes of estimands are identified. One small class, which in particular contains the functions of $\xi$ alone, is only affected by t-ness to the second order, and maximum likelihood estimation in the two- or three-parameter models become equivalent. For all other estimands it is shown that if $m\ge1.458\sqrt{n}$, then maximum likelihood estimation using the incorrect normal model is still more precise than using the correct three-parameter model. This is furthermore shown to be true in regression models with t-distributed residuals. We also propose and analyse compromise estimators that in various ways interpolate between the normal and the nonnormal models. A separate section extends the t-ness results to general normal scale mixtures, in which case the tolerance radius around the normal error distribution takes the form of an upper bound $0.3429/\sqrt{n}$ for the variance of the scale mixture distribution. Proving our results requires somewhat nonstandard `corner asymptotics' since behaviour of estimators must be studied when the crucial parameter $\gamma=1/m$ is close to zero, which is not an inner point of the parameter space, and the maximum likelihood estimator of $m$ is equal to $\infty$ with positive probability.
Read the full abstract

2603.26862 · 27 Mar · 21 pages, 2 figures; Statistical Research Report, Department of Mathematics, University of Oslo, from July 1993, but arXiv'd April 2026. The article is published in Journal of the American Statistical Association, 1994, vol. 89, pages 665-675, in a slightly abridged form, at this url: https://www.tandfonline.com/doi/abs/10.1080/01621459.1994.10476791

Machine Learning (Statistics) · Cross-listed from cs.LG

A Hierarchical Sheaf Spectral Embedding Framework for Single-Cell RNA-seq Analysis

Single-cell RNA-seq data analysis typically requires representations that capture heterogeneous local structure across multiple scales while remaining stable and interpretable. In this work, we propose a hierarchical sheaf spectral embedding (HSSE) framework that constructs informative cell-level features based on persistent sheaf Laplacian analysis. Starting from scale-dependent low-dimensional embeddings, we define cell-centered local neighborhoods at multiple resolutions. For each local neighborhood, we construct a data-driven cellular sheaf that encodes local relationships among cells. We then compute persistent sheaf Laplacians over sampled filtration intervals and extract spectral statistics that summarize the evolution of local relational structure across scales. These spectral descriptors are aggregated into a unified feature vector for each cell and can be directly used in downstream learning tasks without additional model training. We evaluate HSSE on twelve benchmark single-cell RNA-seq datasets covering diverse biological systems and data scales. Under a consistent classification protocol, HSSE achieves competitive or improved performance compared with existing multiscale and classical embedding-based methods across multiple evaluation metrics. The results demonstrate that sheaf spectral representations provide a robust and interpretable approach for single-cell RNA-seq data representation learning.
Read the full abstract

Statistics Theory

Estimation of projection operators with Gaussian noise

This paper focuses on random projection operators when the subspace of projection is estimated. We derive non-asymptotic upper bounds on the error between the projection onto the estimated subspace and the projection onto the underlying subspace. The provided upper bounds depend on the noise and on intrinsic properties of the estimated subspace. Several scenarios are considered according to the distribution of the estimator of the matrix spanning the subspace. The aforementioned bounds are attained under a structural assumption on the Gram matrix associated with the subspace. Regularized estimators are introduced to circumvent this assumption. An example is given in the partial least square (PLS) framework where the estimated subspace is spanned by the PLS weights.
Read the full abstract

Statistical Methodology · Cross-listed from cs.LG

Automatic Laplace Collapsed Sampling: Scalable Marginalisation of Latent Parameters via Automatic Differentiation

We present Automatic Laplace Collapsed Sampling (ALCS), a general framework for marginalising latent parameters in Bayesian models using automatic differentiation, which we combine with nested sampling to explore the hyperparameter space in a robust and efficient manner. At each nested sampling likelihood evaluation, ALCS collapses the high-dimensional latent variables $z$ to a scalar contribution via maximum a posteriori (MAP) optimisation and a Laplace approximation, both computed using autodiff. This reduces the effective dimension from $d_\theta + d_z$ to just $d_\theta$, making Bayesian evidence computation tractable for high-dimensional settings without hand-derived gradients or Hessians, and with minimal model-specific engineering. The MAP optimisation and Hessian evaluation are parallelised across live points on GPU-hardware, making the method practical at scale. We also show that automatic differentiation enables local approximations beyond Laplace to parametric families such as the Student-$t$, which improves evidence estimates for heavy-tailed latents. We validate ALCS on a suite of benchmarks spanning hierarchical, time-series, and discrete-likelihood models and establish where the Gaussian approximation holds. This enables a post-hoc ESS diagnostic that localises failures across hyperparameter space without expensive joint sampling.
Read the full abstract

Statistics Theory

Statistical inference for extremal directions in high-dimensional spaces

In multivariate extreme value statistics, the first step in understanding the dependence structure of extremes is identifying the directions in which they occur. The novelty of this paper is the analysis of high-dimensional extreme value models in which both the model dimension and the number of bias directions go to infinity as the number of observations tends to infinity; we estimate the number of extremal directions. To address the curse of dimensionality, we extend and investigate the information criteria (AIC, BICU, BICL, QAIC and MSEIC) from the fixed-dimensional case (Butsch and Fasen-Hartmann, 2025a; Meyer and Wintenberger, 2023), which employ the concept of sparse regular variation that is closely related to multivariate regular variation, for the estimation of the number of extremal directions. For all information criteria, we derive sufficient conditions for consistency. Unlike in the fixed-dimensional case, where only the Bayesian information criteria (BICU and BICL) and the QAIC are consistent, the AIC and MSEIC are also consistent in high dimensions under certain model assumptions. We compare the performance of the different information criteria in a simulation study that includes a detailed analysis of the model assumptions and the necessary and sufficient conditions for consistency.
Read the full abstract

Statistical Methodology · Cross-listed from cs.LG

Benchmarking Tabular Foundation Models for Conditional Density Estimation in Regression

Conditional density estimation (CDE) - recovering the full conditional distribution of a response given tabular covariates - is essential in settings with heteroscedasticity, multimodality, or asymmetric uncertainty. Recent tabular foundation models, such as TabPFN and TabICL, naturally produce predictive distributions, but their effectiveness as general-purpose CDE methods has not been systematically evaluated, unlike their performance for point prediction, which is well studied. We benchmark three tabular foundation model variants against a diverse set of parametric, tree-based, and neural CDE baselines on 39 real-world datasets, across training sizes from 50 to 20,000, using six metrics covering density accuracy, calibration, and computation time. Across all sample sizes, foundation models achieve the best CDE loss, log-likelihood, and CRPS on the large majority of datasets tested. Calibration is competitive at small sample sizes but, for some metrics and datasets, lags behind task-specific neural baselines at larger sample sizes, suggesting that post-hoc recalibration may be a valuable complement. In a photometric redshift case study using SDSS DR18, TabPFN exposed to 50,000 training galaxies outperforms all baselines trained on the full 500,000-galaxy dataset. Taken together, these results establish tabular foundation models as strong off-the-shelf conditional density estimators.
Read the full abstract

Machine Learning (Statistics) · Cross-listed from cs.LG

Sharp Capacity Scaling of Spectral Optimizers in Learning Associative Memory

Spectral optimizers such as Muon have recently shown strong empirical performance in large-scale language model training, but the source and extent of their advantage remain poorly understood. We study this question through the linear associative memory problem, a tractable model for factual recall in transformer-based models. In particular, we go beyond orthogonal embeddings and consider Gaussian inputs and outputs, which allows the number of stored associations to greatly exceed the embedding dimension. Our main result sharply characterizes the recovery rates of one step of Muon, SGD, and Newton's method on the logistic regression loss under a power law frequency distribution. We show that the storage capacity of Muon significantly exceeds that of SGD, and even matches Newton's method while only using first-order information. Moreover, Muon saturates at a larger critical batch size. We further analyze the multi-step dynamics under a thresholded gradient approximation and show that Muon achieves a substantially faster initial recovery rate than SGD, while both methods eventually converge to the information-theoretic limit at comparable speeds. Experiments on synthetic tasks validate the predicted scaling laws. Our analysis provides a quantitative understanding of the signal amplification of spectral preconditioners and lays the groundwork for establishing scaling laws across more practical language modeling tasks and optimizers.
Read the full abstract

All authors Juno Kim, Eshaan Nichani, Denny Wu, Alberto Bietti, Jason D. Lee

Statistics Applications

Impact of Residential Retrofits on Gas and Electricity Consumption in France

This study examines the impact of residential energy retrofits on household energy consumption in France using smart meter data from nearly 2,500 Hello Watt users, using a two-period difference-in-differences design. The dataset combines daily electricity and gas consumption collected through smart meters, hourly temperatures from Météo France, and user-declared home and retrofit information. As a control, we use a group composed of homes of Hello Watt users that are similar to the treated homes, but did not undergo any renovations. The average treatment effect on the treated is estimated with the estimator of Sant'Anna & Zhao (2020). Estimates are reported by energy source (electricity vs. gas) and by retrofit type. The retrofit measures considered are limited to single interventions: wall insulation, attic insulation, floor insulation, installation of an air-to-air heat pump, or installation of an air-to-water heat pump. A comprehensive retrofit is defined separately as the simultaneous implementation of at least two of these measures. Our results show that insulation works cause a significant decrease in both electricity and gas consumption (3% to 13% and 5% to 16% respectively, depending on the retrofit type). We also estimate the reduction on the heating consumption only (7% to 27% for electrical heating and 7% to 19% for gas heating). We also study retrofits that consist in replacing a gas boiler with an air-to-water heat pump, resulting in a cut of 85% in carbon emissions.
Read the full abstract

All authors Charly Andral, Laetitia Leduc, Guillaume Matheron, Yukihide Nakada

Statistical Methodology

Targeted learning of heterogeneous treatment effect curves for right censored or left truncated time-to-event data

In recent years, there has been growing interest in causal machine learning estimators for quantifying subject-specific effects of a binary treatment on time-to-event outcomes. Estimation approaches have been proposed which attenuate the inherent regularisation bias in machine learning predictions, with each of these estimators addressing measured confounding, right censoring, and in some cases, left truncation. However, the existing approaches are found to exhibit suboptimal finite-sample performance, with none of the existing estimators fully leveraging the temporal structure of the data, yielding non-smooth treatment effects over time. We address these limitations by introducing surv-iTMLE, a targeted learning procedure for estimating the difference in the conditional survival probabilities under two treatments. Unlike existing estimators, surv-iTMLE accommodates both left truncation and right censoring while enforcing smoothness and boundedness of the estimated treatment effect curve over time. Through extensive simulation studies under both right censoring and left truncation scenarios, we demonstrate that surv-iTMLE outperforms existing methods in terms of bias and smoothness of time-varying effect estimates in finite samples. We then illustrate surv-iTMLE's practical utility by exploring heterogeneity in the effects of immunotherapy on survival among non-small cell lung cancer (NSCLC) patients, revealing clinically meaningful temporal patterns that existing estimators may obscure.
Read the full abstract

All authors Matthew Pryce, Karla Diaz-Ordaz, Ruth H. Keogh, Stijn Vansteelandt

Statistical Methodology · Cross-listed from cs.SD

Probabilistic Multilabel Graphical Modelling of Motif Transformations in Symbolic Music

Motifs often recur in musical works in altered forms, preserving aspects of their identity while undergoing local variation. This paper investigates how such motivic transformations occur within their musical context in symbolic music. To support this analysis, we develop a probabilistic framework for modeling motivic transformations and apply it to Beethoven's piano sonatas by integrating multiple datasets that provide melodic, rhythmic, harmonic, and motivic information within a unified analytical representation. Motif transformations are represented as multilabel variables by comparing each motif instance to a designated reference occurrence within its local context, ensuring consistent labeling across transformation families. We introduce a multilabel Conditional Random Field to model how motif-level musical features influence the occurrence of transformations and how different transformation families tend to co-occur. Our goal is to provide an interpretable, distributional analysis of motivic transformation patterns, enabling the study of their structural relationships and stylistic variation. By linking computational modeling with music-theoretical interpretation, the proposed framework supports quantitative investigation of musical structure and complexity in symbolic corpora and may facilitate the analysis of broader compositional patterns and writing practices.
Read the full abstract

Statistics Theory

The relative value of interventional and observational samples in Bayesian Causal Linear Gaussian Models

We investigate the asymptotic properties of Bayesian bivariate causal discovery for Gaussian Linear Structural Equation Models (SEMs) with heteroscedastic noise. We demonstrate that with purely observational data, the posterior distribution over the models fails to consistently identify the true causal structure - a consequence of the fundamental non-identifiability within the Markov Equivalence Class. Specifically, if the true generating mechanism corresponds to a connected graph (A -> B or B -> A), the asymptotic behavior of the posterior is given by the ratio between the prior on the true model and the push-forward prior of the alternative. In contrast, for the independence model, we establish that the posterior concentrates at a stochastic polynomial rate of O_p(n^{-1/2}). To resolve this non-identifiability, we incorporate m interventional samples and characterize the concentration rates as a function of the observational-to-total sample ratio, \eta. We identify a sharp concentration dichotomy: while the independence graph maintains a polynomial O_p(N^{-1/2}) rate (where N = n+m), connected graphs undergo a phase transition to exponentially fast convergence. This highlights an exponential relative importance between the two data types, as altering the amount of one data type directly changes the exponent governing the concentration speed. We derive explicit formulae for the exponential decay rates and provide precise conditions under which mixing observational and interventional data optimizes concentration speed. Finally, our theoretical findings are validated through empirical simulations in Bayesian Gaussian equivalent (BGe)-style prior specifications offering a principled foundation for experimental design in Bayesian causal discovery.
Read the full abstract

All authors Valentinian Lungu, Anish Dhir, Mark van der Wilk, Ioannis Kontoyiannis

Machine Learning (Statistics)

Kantorovich–Kernel Neural Operators: Approximation Theory, Asymptotics, and Neural Network Interpretation

This paper studies a class of multivariate Kantorovich-kernel neural network operators, including the deep Kantorovich-type neural network operators studied by Sharma and Singh. We prove density results, establish quantitative convergence estimates, derive Voronovskaya-type theorems, analyze the limits of partial differential equations for deep composite operators, prove Korovkin-type theorems, and propose inversion theorems. This paper studies a class of multivariate Kantorovich-kernel neural network operators, including the deep Kantorovich-type neural network operators studied by Sharma and Singh. We prove density results, establish quantitative convergence estimates, derive Voronovskaya-type theorems, analyze the limits of partial differential equations for deep composite operators, prove Korovkin-type theorems, and propose inversion theorems. Furthermore, this paper discusses the connection between neural network architectures and the classical positive operators proposed by Chui, Hsu, He, Lorentz, and Korovkin.
Read the full abstract

Statistics Applications · Cross-listed from cs.LG

KMM-CP: Practical Conformal Prediction under Covariate Shift via Selective Kernel Mean Matching

Uncertainty quantification is essential for deploying machine learning models in high-stakes domains such as scientific discovery and healthcare. Conformal Prediction (CP) provides finite-sample coverage guarantees under exchangeability, an assumption often violated in practice due to distribution shift. Under covariate shift, restoring validity requires importance weighting, yet accurate density-ratio estimation becomes unstable when training and test distributions exhibit limited support overlap. We propose KMM-CP, a conformal prediction framework based on Kernel Mean Matching (KMM) for covariate-shift correction. We show that KMM directly controls the bias-variance components governing conformal coverage error by minimizing RKHS moment discrepancy under explicit weight constraints, and establish asymptotic coverage guarantees under mild conditions. We then introduce a selective extension that identifies regions of reliable support overlap and restricts conformal correction to this subset, further improving stability in low-overlap regimes. Experiments on molecular property prediction benchmarks with realistic distribution shifts show that KMM-CP reduces coverage gap by over 50% compared to existing approaches. The code is available at https://github.com/siddharthal/KMM-CP.
Read the full abstract

Statistics Applications

Summarising mortality data with a time-dependent beta latent variable model

Age-specific probabilities of death provide a snapshot of population mortality at the country level at a given point in time. Due to the high dimensionality of the data, summarising mortality information is essential for various analyses, such as visualisation and clustering. We propose the use of beta latent variable (BLV) models to summarise mortality information without data transformation. A time-dependent version of the BLV model is developed by incorporating an autoregressive prior for the latent effects. This model aims to represent mortality data with a small set of $K$ latent effects while accounting for time dependence between these effects. Inference is performed using Bayesian methods, with posterior samples generated via Hamiltonian Monte Carlo. The BLV model is applied to probabilities of death from the Human Mortality Database, covering 41 countries and 23 age-specific probabilities of death over several periods. The time-dependent BLV model with $K=6$ latent effects accurately reconstructs observed mortality data, and the model parameters have intuitive and insightful interpretations. The time-dependent BLV outperforms the standard Gaussian factor analysis model applied to logit probability of death, and demonstrates that BLV models can effectively summarise mortality data.
Read the full abstract

Statistics Theory

Validating spatial-temporal separability for stationary processes

A crucial assumption to reduce computational complexity in spatial-temporal data analysis is separability, which factors the covariance structure into a purely spatial and a purely temporal component. In this paper, we develop statistical inference tools for validating this assumption for a second-order stationary process under both domain-expanding-infill asymptotics and domain-expanding asymptotics. In contrast to previous work on this subject, the methodology neither requires the assumption of normally distributed data, nor uses spectral methods. Our approach is based on nonparametric estimates of measures for the deviation between the covariance matrix and separable approximations, which vanish if and only if the assumption of separability is satisfied. We derive the asymptotic distributions of appropriate estimators for these measures with non-standard limiting distributions and use these results to develop inference tools for validating the assumption of separability. More specifically, we derive confidence intervals for the deviation measures, tests for the hypothesis of exact separability, and for the hypothesis that the deviation from separability is smaller than a prespecified threshold.
Read the full abstract

Statistical Methodology

Mixed Time Series Quasi-Likelihood Models for Uncovering Covid-19 Viral Load and Mortality Dynamics

Accurate real-time monitoring of disease transmission is crucial for epidemic control, which has conventionally relied on reported cases or hospital admissions. Such metrics are frequently susceptible to delays in reporting, various forms of bias, and under-ascertainment. Cycle threshold values obtained from reverse transcription quantitative polymerase chain reaction offer a promising alternative, serving as a proxy for viral load. In this paper, we aim to jointly model the viral load and the number of deaths (mortality), which involves a continuous bounded and a count time series, and therefore, a proper mixed-type model is needed. This is the motivation to introduce a new mixed-valued time series quasi-likelihood (MixTSQL) model capable of analyzing multivariate time series of different types, like continuous, discrete, bounded, and continuous positive. The MixTSQL model only requires a mean-variance specification with no distributional assumptions needed, and allows for testing Granger causality. Statistical guarantees are provided to ensure consistency and asymptotic normality of the proposed quasi-maximum likelihood estimators. We analyze weekly viral load and Covid-19 death counts in São Paulo, Brazil, using our MixTSQL model, which not only establishes the temporal order in which viral load Granger-causes mortality but also offers a comprehensive joint statistical analysis.
Read the full abstract

All authors Kejin Wu, Raanju R. Sundararajan, Michel F.C. Haddad, Luiza S.C. Piancastelli, Wagner Barreto-Souza

Machine Learning (Statistics)

Generative Score Inference for Multimodal Data

Accurate uncertainty quantification is crucial for making reliable decisions in various supervised learning scenarios, particularly when dealing with complex, multimodal data such as images and text. Current approaches often face notable limitations, including rigid assumptions and limited generalizability, constraining their effectiveness across diverse supervised learning tasks. To overcome these limitations, we introduce Generative Score Inference (GSI), a flexible inference framework capable of constructing statistically valid and informative prediction and confidence sets across a wide range of multimodal learning problems. GSI utilizes synthetic samples generated by deep generative models to approximate conditional score distributions, facilitating precise uncertainty quantification without imposing restrictive assumptions about the data or tasks. We empirically validate GSI's capabilities through two representative scenarios: hallucination detection in large language models and uncertainty estimation in image captioning. Our method achieves state-of-the-art performance in hallucination detection and robust predictive uncertainty in image captioning, and its performance is positively influenced by the quality of the underlying generative model. These findings underscore the potential of GSI as a versatile inference framework, significantly enhancing uncertainty quantification and trustworthiness in multimodal learning.
Read the full abstract

Machine Learning (Statistics)

A Power-Weighted Noncentral Complex Gaussian Distribution

The complex Gaussian distribution has been widely used as a fundamental spectral and noise model in signal processing and communication. However, its Gaussian structure often limits its ability to represent the diverse amplitude characteristics observed in individual source signals. On the other hand, many existing non-Gaussian amplitude distributions derived from hyperspherical models achieve good empirical fit due to their power-law structures, while they do not explicitly account for the complex-plane geometry inherent in complex-valued observations. In this paper, we propose a new probabilistic model for complex-valued random variables, which can be interpreted as a power-weighted noncentral complex Gaussian distribution. Unlike conventional hyperspherical amplitude models, the proposed model is formulated directly on the complex plane and preserves the geometric structure of complex-valued observations while retaining a higher-dimensional interpretation. The model introduces a nonlinear phase diffusion through a single shape parameter, enabling continuous control of the distributional geometry from arc-shaped diffusion along the phase direction to concentration of probability mass toward the origin. We formulate the proposed distribution and analyze the statistical properties of the induced amplitude distribution. The derived amplitude and power distributions provide a unified framework encompassing several widely used distributions in signal modeling, including the Rice, Nakagami, and gamma distributions. Experimental results on speech power spectra demonstrate that the proposed model consistently outperforms conventional distributions in terms of log-likelihood.
Read the full abstract

Statistics Applications

Bayesian estimation of optical constants using mixtures of Gaussian process experts

We propose modeling absorption spectrum measurements as mixtures of Gaussian process experts. This enables us to construct a flexible statistical model for interpolating and extrapolating measurements, facilitating statistical integration of Kramers-Kronig relations to estimate the whole complex refractive index. Additionally, we statistically model the anchoring points used in subtractive Kramers-Kronig relations to account for possible measurement errors of the anchor point. In addition to flexible statistical modeling, the mixtures of Gaussian process formulation enables automatic selection of measurement points to use for extrapolation. We apply the method to experimental absorption spectrum measurements of gallium arsenide, potassium chloride, and transparent wood.
Read the full abstract

Statistical Methodology

Making Multi-Axis Models Robust to Multiplicative Noise: How, and Why?

In this paper we develop a graph-learning algorithm, MED-MAGMA, to fit multi-axis (Kronecker-sum-structured) models corrupted by multiplicative noise. This type of noise is natural in many application domains, such as that of single-cell RNA sequencing, in which it naturally captures technical biases of RNA sequencing platforms. Our work is evaluated against prior work on each and every public dataset in the Single Cell Expression Atlas under a certain size, demonstrating that our methodology learns networks with better local and global structure. MED-MAGMA is made available as a Python package (MED-MAGMA).
Read the full abstract