Peer Revenue Returns subject to peer review

Papers

Fresh from arXiv, typeset properly. Highlighted words trade on the market.

Statistics

stat Watch Statistics (sign in to use)

Wednesday 29 July

Machine Learning (Statistics)

An analysis of binary isotonic regression: degrees of freedom and implications for calibration

Isotonic regression is a canonical tool for estimating monotone functions and calibrating probabilistic predictors. We provide a fully sharp finite-sample characterization of its worst-case degrees of freedom on binary samples. Specifically, we identify the binary sequences that maximize the number of distinct fitted values produced by isotonic regression. We develop a sharp bound on the degrees of freedom with a leading term of $\frac{3}{(4\pi^2)^{1/3}} n^{2/3}$ using analytic number theory, improving on previous bounds. We then apply this result to calibration. Calibration is a central requirement for probabilistic prediction, and isotonic regression is a widely used post-processing method for improving calibration. Building on deterministic degrees-of-freedom bounds, we derive, to our knowledge, the first nontrivial distribution-free guarantee on the Expected Calibration Error (ECE) of isotonic regression. This ECE bound is fully model-free and distribution-free, only assuming $Y \in \{0,1\}$.
Read the full abstract

All authors Raphael Rossellini, Rina Foygel Barber, Zhimei Ren, Jake A. Soloff

Machine Learning (Statistics)

Expected Survival-Time Bounds for Robust Optimization Over Time under Isotropic Gaussian Dynamics

Robust Optimization Over Time (ROOT) is a recent branch of evolutionary dynamic optimization that seeks solutions capable of remaining effective across multiple consecutive environments. Unlike the traditional track-the-moving-optimum (TMO) paradigm, which reoptimizes after every environmental change, ROOT explicitly values persistence. Although the field has grown considerably, most contributions remain algorithmic and empirical, leaving several fundamental properties poorly understood from a theoretical perspective. One such property is survival time, defined as the number of future environments in which a deployed solution continues to satisfy a prescribed quality threshold. While survival time is widely used as a measure of temporal robustness, little is known about how its expected value depends on environmental dynamics, deployment quality, or problem characteristics. This paper studies expected survival time for a fixed deployed solution under isotropic Gaussian environmental dynamics. Modeling survival as a discrete first-exit problem, we derive a rigorous lower bound and a computable multi-step upper bound. The analysis shows that expected survival scales as ${\Theta}({\sigma}^-{2})$ in slowly varying environments and approaches its minimum value of one future change in high dimensions. A comprehensive Monte Carlo study validates the theoretical predictions, examines sensitivity to modeling assumptions and parameter uncertainty, and illustrates how the bounds can support deployment decisions after optimization. The resulting framework provides an analytical characterization of deployment lifetime and identifies when a required deployment horizon can be guaranteed, ruled out, or remains analytically unresolved.
Read the full abstract

Machine Learning (Statistics) · Cross-listed from cs.LG

Rethinking EEG-Based Disease Diagnosis: Decoupling Instance Representation Learning from Subject-Level Supervision

EEG-based disease diagnosis requires one prediction per subject, yet common pipelines segment recordings into short instances, inherit the subject label for every instance, and train instance-level classifiers. This assumes that all instances provide equally reliable diagnostic evidence. Multiple instance learning (MIL) avoids inherited labels by treating each subject as a bag. However, EEG datasets contain far fewer subjects than instances, which can limit the quality of the representations learned by end-to-end MIL. We propose BridgeMIL, a two-stage framework that decouples instance representation learning from subject-level supervision. Stage 1 pretrains the encoder without inherited instance labels by aligning temporally nearby windows and independently sampled within-subject sub-bags. Variance and covariance regularization prevent collapse and reduce redundancy without negative pairs. Stage 2 transfers the encoder to an attention-based MIL aggregator, applies supervision only to subject predictions, and limits representation drift through feature retention. Across three EEG disease datasets and five representative backbones, BridgeMIL attains the highest mean accuracy in 14 of 15 dataset-backbone settings and an overall mean accuracy of 76.57%, 4.28 percentage points higher than the strongest baseline. Further analyses reveal substantial variation in inherited-label reliability across instances, greater performance sensitivity to subject scarcity than to instance scarcity, and a more structured representation space with distinct subject-wise clusters and improved separation between diagnostic classes. Together, these findings underscore the importance of aligning supervision with the subject-level prediction objective while learning from abundant EEG instances without assigning disease labels to individual instances.
Read the full abstract

All authors Zhiyuan Ma, Zeyuan Li, Zhiyi Lu, Jiacheng Hao, Youlang Du, Zhen Jiang, Xinche Zhang, Yuhao Sun, Xinke Shen, Sen Song

Statistical Methodology · Cross-listed from cs.LG

DoTime: A Synthetic Benchmark Generator for Interventional and Counterfactual Time Series

Most benchmarks for causal inference over time series are observational, small, or domain-specific, leaving interventional and counterfactual estimation under-served exactly where it matters most, such as in healthcare, policy evaluation, and climate science. We introduce DoTime, an open, scalable, and theoretically grounded generator of multivariate temporal structural causal models (TSCMs) with interventions, released as the \code{dotime} PyPI package together with four frozen evaluation suites. Beyond existing work, it adds capabilities absent from prior generators: continuous-time intervention windows, counterfactual sampling modes with a positivity guard, regime-switching SCMs as a strict generalization of interrupted time series, non-stationary dynamics by construction with switching SCM parameters, and deterministic ramp and sinusoidal intervention profiles that place trends and structural breaks inside the evaluation window. Moreover, it demonstrates the suitability of the generator as a prior for a causal foundation model reference implementation. The released suites span a training-scale snapshot of $100{,}000$ trajectories and eight named identification structures, each with exact ground truth: paired interventional trajectories from the same SCM throughout, and shared-noise counterfactuals in the continuous-time suite. We ship reference baseline implementations with an evaluation harness, and pose a falsifiable claim: interventional training buys a measurable direction-accuracy advantage over an observational model of identical capacity. It is tested across three training seeds per arm. Under structure-matched evaluation on held-out episodes, the interventional prior-fitted network's (PFN) gap is positive in every structure, trajectory length, and seed tested.
Read the full abstract

Other Statistics

The Fidelity and Feedback Traps: The Case for Health Digital Twins as Modular Evolving Causal Systems

Digital twins for health may be used to compare treatments, project patient trajectories, and support clinical decisions. While related to mechanical digital twins, those initially developed for engineering applications, replicating the mechanical digital twin architecture and goals may fail in health for two reasons. The fidelity trap is the belief that an accurate model can answer what-if questions by virtue of its accuracy. Prediction and counterfactual reasoning are different tasks, and a twin that can fit past trajectories well may miss the mark when ranking treatments. The feedback trap arises when the twin updates on data its own recommendations helped generate. Refitting in this way can recover a biased relationship and grow more confident even as data grows thinner. We contend that health digital twins should be conceived as causally valid, modular, and evolving systems. Modularity isolates the data and models needed for interventional recommendations, causal validity supports such claims, and governed evolution updates the twin while accounting for how its recommendations reshape the data. We conclude that the standard for a health twin should be how well it supports decisions in the world it helps create, not how faithfully it reproduces the world it observes.
Read the full abstract

All authors Nikki L. B. Freeman, Yating Zou, Kyungbok Lee, Chenyao Yu, Didong Li, Michael R. Kosorok

Statistical Methodology

An Interpretable Low-Rank State-Space Model for Multi-Horizon Simulation of Large-Scale Regional Temperature Fields

We propose an interpretable low-rank state-space model for conditional simulation of daily regional temperature fields. The central statistical question is whether empirical orthogonal functions (EOFs) can be treated as stable large-scale features of the field rather than only as sample-dependent basis vectors for dimension reduction. The framework represents the dominant temperature field through a small number of retained EOF coefficients, models their seasonal mean and variance structure, propagates the resulting low-dimensional state with stable multivariate dynamics, and uses structured innovations to represent the remaining uncertainty. The resulting reduced-rank model is interpretable, computationally efficient, and suitable for iterative ensemble generation. It is designed to support both inference on the structure of the retained temperature state and prediction through multi-horizon probabilistic field simulation.
Read the full abstract

Statistics Applications

Rainfall is rough

We propose a new approach to model rainfall by combining heterogeneous data sources at different time scales. Continuous arrivals of rain cells are incorporated into a Hawkes process formalism that encompasses the classical Bartlett-Lewis and Neyman-Scott models, thereby providing a more flexible representation of clustering. Analysis of high frequency rainfall data (at the minute scale over several years) indicates that critical Hawkes processes with heavy-tailed power-law kernels yield a superior fit relative to classical models and alternative kernel specifications. Scaling arguments inspired by Jaisson and Rosenbaum (2016) imply that aggregated rainfall at coarse time scales converges to a rough fractional process with Hurst exponent close to zero. This prediction is supported by empirical evidence from low-frequency data (annual observations spanning centuries to millennia), where the Hurst exponent is estimated to lie between 0.01 and 0.1 based on either direct observations from weather stations or proxy reconstructions such as tree-ring records. These results establish a connection between rainfall dynamics and models developed in quantitative finance for market microstructure and volatility. They also provide a new perspective on classical scaling phenomena originally studied by Hurst and Mandelbrot.
Read the full abstract

Statistical Methodology · Cross-listed from cs.DS

Linear time approximation of the TV distance between product distributions

We present a linear time approximation algorithm of the total variation distance between two product distributions. The main algorithm was found using ChatGPT 5.6 Sol Ultra.

Statistics Theory

The Kaplan-Meier estimator as a limit function of Efron's self-consistency iterations

In 1967 Efron showed that the Kaplan-Meier estimator can be defined as a fixed point of a certain mapping, calling this property “self-consistency”. He also proposed an iterative algorithm for approximating this fixed point and suggested its convergence. The purpose of the present note is to prove this fact.
Read the full abstract

Machine Learning (Statistics)

PIKS: Universal Physics-Informed Kernel Methods

Physics-informed machine learning incorporates physical principles –often expressed via differential operators– into data-driven models. While physics-informed neural networks (PINNs) dominate empirical applications, the complexity of neural network architectures and optimization landscapes hinders the development of a corresponding learning theory. In turn, kernel methods offer an appealing alternative with closed-form solutions and analytical tractability, yet existing guarantees primarily cover the well-specified setting where the target belongs to the native Reproducing Kernel Hilbert Space (RKHS). This imposes unrealistic regularity assumptions that physical targets often fail to satisfy. In this paper, we introduce and analyze Physics-Informed Kernel methodS (PIKS). We establish the universal consistency of PIKS for linear differential constraints, proving that for universal kernels (such as Gaussian or Matérn), the estimator asymptotically learns the target while satisfying physical constraints. We further derive finite-sample bounds under suitable source conditions. Our analysis is based on extending classical operator-theoretic analysis of kernel methods to physics-informed machine learning. Numerical experiments demonstrate that PIKS can be competitive with PINNs and traditional finite element methods.
Read the full abstract

All authors Joachim Bona-Pellissier, Giacomo Meanti, Matteo Santacesaria, Lorenzo Rosasco

Statistics Theory · Cross-listed from math.PR

Second-Order Multi-Set Allocation Occupancy (MAO) Distributions under Pairwise-Intersection Constraints: Exact Laws, MAO Norms, Inequalities, and Limit Theory

Our previous work established the multi-set allocation occupancy (MAO) distribution theory, including the norms, inequalities, and limit theory, under constraints on set sizes alone. By further conditioning on all pairwise intersections while leaving triple and higher-order membership patterns random, we develop the second-order extension. This extension naturally identifies the earlier marginal-size-only framework as the first-order MAO theory. Let $N$ be the population size, $T$ the number of labelled sets, and $M$ a feasible symmetric matrix whose diagonal and off-diagonal entries specify marginal sizes and pairwise intersections. Write $a=(a_B)_{B\subseteq[T]}$ for the atomic membership counts, where $a_B$ is the number of elements belonging to exactly the sets indexed by $B$, and let $A(N,M)$ be the resulting feasible atomic region. With labelled multiplicity $w(a)=N!/\left(\prod_{B\subseteq[T]}a_B!\right)$, $Z_{N,M}=\sum_{a\in A(N,M)}w(a)$, we define the second-order exact-$t$ and at-least-$t$ MAO norms by the direct atom formulas $\lVert t^r\rVert_T=\left(\sum_{a\in A(N,M)}\left(\sum_{|B|=t}a_B\right)_r w(a)\right)/\left((N)_r Z_{N,M}\right)$, $\lVert [t,T]^r\rVert_T=\left(\sum_{a\in A(N,M)}\left(\sum_{|B|\geq t}a_B\right)_r w(a)\right)/\left((N)_r Z_{N,M}\right)$. The moments can be calculated exactly based on the norms: If $X_{=t}$ and $X_{\geq t}$ denote the numbers of elements with membership degree exactly $t$ and at least $t$, respectively, then for every $\nu\geq1$, $\mathbb{E}_{N,M}[X_{=t}^{\nu}]=\sum_{i=1}^{\nu}S(\nu,i)\lVert t^i\rVert_T$, $\mathbb{E}_{N,M}[X_{\geq t}^{\nu}]=\sum_{i=1}^{\nu}S(\nu,i)\lVert [t,T]^i\rVert_T$. We further developed Poisson and normal limiting theory, verified by numerical approximation. The model provides a systematic route to higher-order MAO theories by prescribing intersections up to any chosen order.
Read the full abstract

Statistical Methodology

Recovering the Target Hazard Ratio Under Nonproportional Hazards Induced by an Omitted Covariate: Simulation-based Approach

When an omitted covariate whose inclusion would balance proportional hazards is excluded from a proportional hazards model, bias in the estimated treatment effect may arise. The omitted covariate may represent an unobservable biomarker status, an overlooked stratification factor, or a strong continuous prognostic factor. In this paper, we propose a simple simulation-based approach for recovering the target hazard ratio for treatment effect, defined as the hazard ratio from the correctly specified proportional hazards model that includes the omitted covariate. Our approach identifies the target hazard ratio value that generates a band of survival curves enclosing the observed survival curve estimates most, under the minimal assumptions of a Weibull baseline event-time distribution, (a mixture of) uniform censoring, and unit variance of the omitted covariate. Simulation studies indicate that the proposed method recovers the target hazard ratio reasonably well under practical scenarios involving a broad range of true hazard ratios, regardless of the true distribution of the omitted covariate. Consistency of the empirical estimates from the proposed procedure to the true values is proved. We illustrate the proposed method using data from a phase III breast cancer clinical trial.
Read the full abstract

Machine Learning (Statistics) · Cross-listed from cs.LG

BayesAME: Bayesian Active Model Evaluation

Evaluating large generative models across benchmarks is time-consuming and computationally expensive. This drives the need for methods that can estimate full benchmark performance by evaluating models on only a subset of items, known as a coreset. Current literature mostly requires the practitioner to input a coreset size. However, when reliable performance estimation takes priority over efficiency, an evaluation method should also be capable of automatically determining a coreset size that reflects this priority. We introduce BayesAME, a sequential Bayesian framework specifically targeting automatic determination of the coreset size. BayesAME models performance as a random variable by defining a latent ability for each group of items sharing the same historical model performances, with a joint prior distribution encoding the belief that the target model behaves similarly to these historical models. The posterior distribution over these abilities is used to derive performance estimators, quantify performance uncertainty, and select items to add to the coreset via an information-gain criterion. The coreset is iteratively augmented until the performance estimate fluctuation and the performance uncertainty fall below their respective user-defined thresholds. We propose a multi-target extension that captures performance correlations across multiple target models to further reduce the coreset size. Through extensive experiments across diverse benchmarks, we demonstrate that BayesAME consistently outperforms sequential adaptations of existing methods. Crucially, our comprehensive analysis addresses recent skepticism in the literature, establishing that non-random coreset selection is advantageous over random selection. Finally, we highlight that leveraging continuous response log-likelihoods over traditional binary scores significantly enhances estimation accuracy.
Read the full abstract

All authors Paula Cordero Encinar, Taylan Cemgil, Arnaud Doucet, Virginia Aglietti, Silvia Chiappa

Statistical Methodology

PRESCCO: Efficient Prediction Intervals under a Right-Censored Covariate

In clinical studies, a patient's outcome, e.g., a cognitive test score, is typical or atypical depending on how it compares with the outcomes of patients at a similar point in a neurodegenerative disease, measured by how far they are from a common disease event. A prediction interval based on the time to that event provides that comparison, but that time is right-censored for most patients. Yet no method had computed such a prediction interval in this right-censored covariate setting. We first adapt three conformal prediction methods to this setting, and show that the estimated half-length, the distance the interval runs either side of its center, varies from one study to the next, so the same outcome can be judged typical in one study and atypical in another. We then develop the PRESCCO method, whose estimator of the half-length is semiparametrically efficient and doubly robust, staying consistent when one of its two models is misspecified, while the method loses no coverage. In simulations its standard deviation is four to thirty times smaller than under any conformal prediction method, and in a Huntington disease study with 77.2% right-censoring, an outcome typical in one study is no longer atypical in another.
Read the full abstract

All authors Kihyun Han, Yanyuan Ma, Karen Marder, Tanya P. Garcia

Machine Learning (Statistics)

Feature Bagging Provides Stability

We study feature bagging through the lens of algorithmic stability. Feature bagging is an ensemble strategy that aggregates base learners trained on randomly subsampled feature subsets, possibly in a data-dependent manner. We introduce feature instability (FI), the feature-axis analogue of instance instability (II), which measures sensitivity to removing a single feature. Smaller values of II or FI correspond to stronger stability, and our experiments show that FI captures generalization-relevant information complementary to II. Within this framework, we analyze feature bagging in both a parametric linear model and a model-free setting inspired by recursive feature subsampling in random forests. In both settings, we establish formal guarantees showing that feature bagging improves the relevant stability relative to its non-bagged counterpart, with larger improvements under more aggressive subsampling. We further show that a modest number of bagging rounds is sufficient to approach the infinite-bagging stability level.
Read the full abstract

Machine Learning (Statistics)

Breaking the Curse with BAND: Nonparametric Distribution Estimation in High Dimensions

Minimax-optimal rates for multivariate distribution estimation are known to suffer from the curse of dimensionality. We propose a sparse Bayesian network approach in which each conditional probability is estimated using sparsity-aware conditional mean methods. The resulting estimator, BAyesian Network Distribution regression (BAND), handles mixed data types in high-dimensional time series and achieves polynomial total variation convergence rates while allowing the feature dimension to grow polynomially with the sample size. These rates are substantially faster than the classical optimal rates for multivariate histogram density estimators that lack sparsity. Empirical evaluations show that BAND performs competitively for data sampling and confidence region forecasting against a range of state-of-the-art benchmarks.
Read the full abstract

Statistical Methodology

Bayesian Plackett–Luce latent block models for ranked data

We introduce a Bayesian latent block model that jointly partitions assessors and items under a Plackett–Luce observation model. Assessors are assigned to $C$ clusters and items to $K$ blocks; items in a block share a common strength parameter within each assessor cluster, yielding a parsimonious $C\times K$ co-clustering representation. Independent Gnedin priors infer $C$ and $K$. Data augmentation gives conjugate Gibbs updates and a tractable MCMC sampler with split-merge moves. Simulations characterize recovery and posterior uncertainty as signal, ranking depth, and group balance vary. Applied to the cancer gene atlas (TCGA) pan-cancer top-500 gene-expression rankings, the model reveals tissue-driven sample structure while compressing gene-level heterogeneity into interpretable blocks. Rank-based GSEA of posterior gene scores supports biological interpretation.
Read the full abstract

Machine Learning (Statistics)

Conformalized Rate-Adaptive Sensing

Many high-resolution imaging systems face the same fundamental question: when have enough measurements been collected to reconstruct an image accurately? We develop Conformalized Rate-Adaptive Sensing (CoRAS), a method that adaptively chooses an acquisition or compression rate for each image while keeping the reconstruction error below a target level with high probability. As measurements are collected, an image reconstruction model gradually recovers the true image, producing a reconstruction path over acquisition rates. CoRAS uses this path up to an early decision time to estimate the target stopping time, defined as the first time at which the reconstruction error falls below the target level. It then calibrates this estimate using images with similar early reconstruction behavior, producing an upper bound on the stopping time with marginal and approximate conditional coverage guarantees. Experiments on image datasets show that CoRAS attains the target stopping-time coverage, uses fewer measurements on average than fixed-rate stopping rules, and assigns more measurements to images that are harder to reconstruct.
Read the full abstract

Machine Learning (Statistics)

Think Short, Defer Smart, Act, and Repeat: Calibrated Reasoning and Uncertainty-Aware Deferral for Edge LLM Agents

LLM agents following the ReAct paradigm are promising enablers of complex multi-step tasks, including multi-hop question answering, code generation, and control of physical AI systems. Yet, when deployed at the edge, they must tightly manage their reasoning budget while remaining reliable and deferring to a cloud-side model only when local uncertainty is too high to act safely. We propose Think Short, Defer Smart (TSDS), a framework that synergistically integrates a lightweight convergence probe, which halts on-device reasoning once the intended action has stabilized, with a perplexity-based deferral rule that escalates uncertain actions to a cloud-side model. Both mechanisms are jointly calibrated on end-to-end episode trajectories via a multi-objective Learn-Then-Test (LTT) procedure, providing simultaneous finite-sample guarantees on expected episode reward and cloud-call rate. We evaluate TSDS on four ReAct benchmarks spanning arithmetic reasoning (GSM8K), multi-hop question answering (HotpotQA), code generation (MBPP), and multi-step embodied planning (household robot), and compare against thought-calibration-only and calibrated-deferral-only standalone baselines. TSDS reduces per-episode thinking compute by 43%-65% over deferral-only baselines across HotpotQA, MBPP, and the household robot task, while maintaining certified reward and cloud-call rate guarantees.
Read the full abstract

Statistical Methodology

Uniform Convergence of Generalized Conditional Fréchet Means with Applications to Weighted Fréchet Aggregation and Exceedance Set Estimation

The statistical analysis of object oriented data in non-Euclidean spaces heavily relies on generalized conditional Fréchet means, notably in the context of Fréchet regression. However, establishing the uniform convergence of these estimators presents several theoretical challenges. The difficulties are caused primarily by the absence of linear structures in general metric spaces, rendering standard techniques for verifying the asymptotic uniform equicontinuity of the estimator largely intractable. To overcome this limitation, this paper introduces an alternative theoretical framework for establishing uniform convergence that bypasses the need to verify uniform equicontinuity, under a novel structural condition on the empirical cost function of the generalized conditional Fréchet means. We demonstrate that this analytical condition is satisfied by various prominent Fréchet regression models across broad classes of metric spaces. Leveraging these foundational uniform convergence guarantees, we subsequently extend two widely used frameworks from Euclidean to non-Euclidean spaces: (i) a weighted Fréchet aggregation framework that facilitates both distributed regression and robust median-of-means regression; and (ii) an exceedance set estimation framework to identify critical covariate regions where the conditional generalized Fréchet mean surpasses a prescribed threshold, alongside a metric to quantify the aggregate magnitude of the exceedance. The theoretical properties of these proposed methods are empirically validated through Monte Carlo simulations and an application to dynamic transportation networks in New York City.
Read the full abstract

Machine Learning (Statistics)

Crossing-Free Probabilistic K-Line Forecasts Without Retraining

Probabilistic K-line forecasting describes uncertainty in four complementary prices, namely open–high–low–close (OHLC). However, it introduces two consistency problems: quantile crossing and K-line crossing. Quantile crossing occurs when a higher-quantile forecast falls below a lower-quantile forecast, while K-line crossing occurs when the forecast low exceeds the open or close, or the forecast high falls below the open or close. Existing solutions generally address only one problem through output reordering, specialized architectures, or penalized training objectives. We propose K-line–Quantile Sequential Projection (KQSP), a parameter-free and training-free reconciliation method applicable to forecasts produced by any model. Compared with other crossing solutions, KQSP preserves predictive accuracy while producing substantially smaller corrections to the original forecasts. To mitigate model bias, we evaluate KQSP using various models, including pretrained foundation models. KQSP reduces both quantile and K-line crossing rates to zero for all test data undertaken. These results show that probabilistic K-line consistency can be enforced independently of forecast generation and without retraining.
Read the full abstract

All authors Runyao Yu, Yuchen Tao, Yujie Chen, Wentao Wang, Derek W. Bunn

Statistics Theory

Compactly supported radial basis functions as probability density functions

Compactly Supported Radial Basis Functions (CS-RBFs) are a fundamental tool in multivariate approximation theory. However, their use in statistics and probability modeling remains underexplored, having been used mainly to express covariance functions in Gaussian processes or as kernel functions. This work explores CS-RBFs as a novel parametric family of probability density functions, focusing in particular on Wendland $\mathscr{C}^2$ kernels. The primary contribution of this work is the derivation of analytical expressions for various statistical properties, such as moments and the cumulative distribution function, of CS-RBFs as univariate and conditional densities. The approach comprises two alternative scenarios: when the CS-RBF support lies entirely within the variable's domain (untruncated support) and when part of it is outside (truncated support). Mixture models employing CS-RBFs are also analyzed, and their main properties are detailed. Furthermore, we introduce an incremental learning algorithm for density estimation with CS-RBF mixture models, in which centers are determined using k-means and weights and shape parameters are optimized by stochastic gradient descent. Experiments on synthetic and real-world datasets show that CS-RBF densities provide competitive results in terms of likelihood and model complexity in comparison with Gaussian mixture models. In addition, these CS-RBF densities allow the exact computation of key distributional properties in univariate and conditional settings.
Read the full abstract

Statistical Methodology

Robust Interpolated Quantile Estimators: Asymptotic Theory and Efficiency

This paper introduces a unified family of interpolated quantile estimators obtained by augmenting the check loss with quadratic, Huber, or Tukey's bisquare regularization. The estimators are indexed by the quantile level $\tau$ and an interpolation parameter $h$. They reduce to the classical empirical quantile when $h=0$, while increasing $h$ continuously shifts the effective probability level toward the center of the distribution. A complete asymptotic theory is developed. For the quadratic interpolation, the effective quantile level is characterized by an interpolation equation yielding a closed-form parametrization of neighboring quantiles. Asymptotic normality is established for all three interpolated estimators via M-estimation, and a decomposition of the asymptotic variance explains how efficiency depends on the underlying distribution. Numerical experiments show that the quadratic interpolated estimator can reduce asymptotic variance by up to 36% for light-tailed distributions and up to 57% for heavy-tailed or asymmetric distributions for suitable interpolation strength. The framework is extended to linear quantile regression, where Monte Carlo experiments show that Huber interpolation is beneficial only in a narrow neighborhood of the median, while ordinary quantile regression remains preferable elsewhere. An application to daily log-returns illustrates the practical relevance of the proposed methodology for tail estimation under heavy tails and asymmetry.
Read the full abstract

All authors Saïd Maanan, Azzouz Dermoune, Ahmed El Ghini, Daoud Ounaissi

Machine Learning (Statistics)

Early Failure Prediction from Near-Anomaly Detection: A Proactive Approach

Anomaly detection methods often have uncertain behavior with respect to samples near the distribution boundary, limiting their ability to anticipate future anomalies. This work introduces the concept of near-anomalies that, while not yet anomalous, lie close to the boundary and are likely to transition into anomalies in the near future. To address this, we propose an unsupervised method, named Christoffel-based ANomaly Anticipation for eaRly dIscovery (CANARI), which leverages the strong theoretical foundations of the Christoffel function to detect near-anomalies. The method is validated on industrial in-circuit testing data from printed circuit boards, with synthetically generated near-anomaly samples due to the lack of real-world data labeling. Experimental results show that CANARI outperforms the compared baselines that generally use a dual-threshold mechanism (one for anomalies and one for near-anomalies). It therefore provides a proactive solution for anticipating anomalies before they occur, offering a promising approach for resilience, predictive maintenance, and quality control.
Read the full abstract

All authors Léa Billet, Louise Travé-Massuyès, Elodie Chanthery, Alexandre Gaffet

Machine Learning (Statistics) · Cross-listed from cs.LG

Universality and Approximation Rates of Graph Neural Networks with Random Features

We investigate message-passing graph neural networks with random node features. Random node features are known to enhance the expressiveness of graph neural networks (GNNs) both theoretically and empirically. Here, we establish a novel universality result focusing on permutation-equivariant neural networks (PENNs), a class of GNNs built from feedforward neural network components that subsumes many prominent GNN architectures. We show that PENNs, combined with partially random node features, can approximate arbitrarily well in probability any measurable permutation-invariant or permutation-equivariant function on directed graphs of fixed size with multidimensional node and edge features. For $k$-times continuously differentiable functions, $k\geq 2$, we also derive upper bounds on the approximation rates, relating the complexity of the feedforward components of a PENN in terms of layer depth and number of nonzero weights to the desired approximation accuracy.
Read the full abstract

Statistics Applications · Cross-listed from physics.soc-ph

Structure of System-Specific Hazard Modeling for Physical Infrastructures in a Climate Change Context

This paper addresses the definition and modeling of hazards in the context of physical systems, particularly infrastructures, that are affected by climate change. The paper highlights that hazards are system-dependent, meaning what constitutes a hazard for one system (e.g., humans) may not be the same for another (e.g., infrastructures). The paper also highlights that extreme intensity distribution may evolve in a region without necessarily constituting a hazard for a specific system. These distinctions are crucial for risk assessment and adaptation strategies in a changing climate. The paper implements a simple threshold-based hazard model -Boolean Hazard Model with Probability -to focus exclusively on system-specific hazard definition in climatechange context. Use cases illustrate how this approach adapts to different systems and hazard types. The model produces time-evolving hazard maps, delivering hazard data tailored to both hazard type and infrastructure characteristics. The model provides hazard data tailored to specific hazard types and physical systems, with a focus on infrastructure. The use cases demonstrate their practical value and potential for broader application in multi-infrastructure and multi-hazard exposure modeling.
Read the full abstract

Statistics Theory

Hub Neighbor-Degree Diagnostics for Sparse Random Graphs

Networks with nearly identical degree distributions can place their hubs in sharply different neighborhoods. We develop a model diagnostic based on the mean degree of the neighbors of a degree-$k$ vertex. Under rank-one inhomogeneous random graphs, this statistic has degree-invariant centering and $k^{-1/2}$ fluctuations. Under non-rank-one kernels, posterior uncertainty about the root type can instead determine both centering and scale. Under linear preferential attachment, the statistic grows as $(m+\delta)\log k$. We turn these model-specific limits into goodness-of-fit tests for specified sparse-graph nulls and a weighted log-degree slope test for residual hub-neighborhood trends. Simulations evaluate null calibration, degree-distribution misspecification, and power against degree-matched preferential-attachment alternatives. Applications to high-school contact and arXiv coauthorship networks show that the method separates level misspecification from disassortative and positive residual trends. Reddit interaction networks provide a further appendix example.
Read the full abstract

Statistics Applications · Cross-listed from gr-qc

Bayesian nonparametric estimation of correlated gravitational wave detector network noise using matrix-gamma process priors

This paper addresses the important problem of estimating the noise spectral density of next-generation gravitational-wave detectors, such as LISA and the Einstein Telescope (ET), where cross-channel correlations must be accounted for to avoid biased parameter estimation of gravitational-wave signals. Unlike approaches that estimate test-mass and optical-metrology-system noise separately at the single-link level and then map them to the Time-Delay Interferometry (TDI) channels through known transfer functions, we develop a Bayesian nonparametric method that directly estimates the spectral density matrix of the XYZ channels, thereby accommodating additional sources of uncertainty. Our approach combines a flexible matrix-gamma process prior on the matrix-valued coefficients of a Bernstein polynomial basis expansion with a blocked multivariate Whittle likelihood. The prior guarantees Hermitian positive definiteness of the spectral estimate at every frequency. To avoid reversible-jump methods, we use an adaptive Markov chain Monte Carlo (MCMC) algorithm for posterior sampling. The proposed framework can also be used to correct misspecified parametric noise models. Results from a simulation study and simulated correlated-noise data for both LISA and ET demonstrate the effectiveness of the proposed method.
Read the full abstract

All authors Yixuan Liu, Renate Meyer, Nelson Christensen, Jeung Eun Lee, Jianan Liu, Patricio Maturana-Russel, Avi Vajpeyi

Statistical Methodology · Cross-listed from math.NA

Bayesian Inference of Discretization Error Means in ODEs via Ensemble Kalman Filtering

We propose a Bayesian framework to quantify discretization errors in numerical solutions of ODE models based on observational data. The discretization error is modeled as a random variable, and its mean-referred to as the discretization error mean-is inferred from the observations. By introducing a Markov prior on the temporal evolution of the discretization error mean, we formulate the problem as a state-space model with a linear Gaussian observation process, which enables efficient inference via the Ensemble Kalman Filter. We also propose a specific form of a Markov prior motivated by classical discretization error analysis, in which global errors accumulate from local errors. The proposed prior depends on the step size of a numerical solver, and we establish its convergence rate in probability as the step size tends to zero. Numerical experiments on the pendulum system and the FitzHugh-Nagumo model demonstrate the effectiveness of the proposed approach.
Read the full abstract

Statistics Theory · Cross-listed from math.PR

An RDT based confirmation of Lehner's formula for Kronecker-Gaussian matrices

Remarkable breakthroughs [25,43] established the so-called strong asymptotic freeness between classical Gaussian random ensembles and their semicircular free counterparts. Along the same lines, the Lehner formula [31], associated with the free counterpart, precisely determines the spectral edges of Kronecker-Gaussian matrices. We here revisit and study this formula without the utilization of random matrix theory and spectral methods. In particular, relying on concepts utilized within Random Duality Theory (RDT) [45,46,51], we reconfirm Lehner's formula and effectively reprove the key asymptotic freeness results obtained via spectral methods in [25,43].
Read the full abstract