Machine Learning (Statistics)
An analysis of binary isotonic regression: degrees of freedom and implications for calibration
Raphael Rossellini, Rina Foygel Barber, Zhimei Ren et al. (+1 more)
Isotonic regression is a canonical tool for estimating monotone functions and calibrating probabilistic predictors. We provide a fully sharp finite-sample characterization of its worst-case degrees of freedom on binary samples. Specifically, we identify the binary sequences that maximize the number of distinct fitted values produced by isotonic regression. We develop a sharp bound on the degrees of freedom with a leading term of $\frac{3}{(4\pi^2)^{1/3}} n^{2/3}$ using analytic number theory, improving on previous bounds. We then apply this result to calibration. Calibration is a central requirement for probabilistic prediction, and isotonic regression is a widely used post-processing method for improving calibration. Building on deterministic degrees-of-freedom bounds, we derive, to our knowledge, the first nontrivial distribution-free guarantee on the Expected Calibration Error (ECE) of isotonic regression. This ECE bound is fully model-free and distribution-free, only assuming $Y \in \{0,1\}$.
Read the full abstract ▾
All authors Raphael Rossellini, Rina Foygel Barber, Zhimei Ren, Jake A. Soloff
Machine Learning (Statistics)
Expected Survival-Time Bounds for Robust Optimization Over Time under Isotropic Gaussian Dynamics
Pavel Novoa-Hernández
Robust Optimization Over Time (ROOT) is a recent branch of evolutionary dynamic optimization that seeks solutions capable of remaining effective across multiple consecutive environments. Unlike the traditional track-the-moving-optimum (TMO) paradigm, which reoptimizes after every environmental change, ROOT explicitly values persistence. Although the field has grown considerably, most contributions remain algorithmic and empirical, leaving several fundamental properties poorly understood from a theoretical perspective. One such property is survival time, defined as the number of future environments in which a deployed solution continues to satisfy a prescribed quality threshold. While survival time is widely used as a measure of temporal robustness, little is known about how its expected value depends on environmental dynamics, deployment quality, or problem characteristics. This paper studies expected survival time for a fixed deployed solution under isotropic Gaussian environmental dynamics. Modeling survival as a discrete first-exit problem, we derive a rigorous lower bound and a computable multi-step upper bound. The analysis shows that expected survival scales as ${\Theta}({\sigma}^-{2})$ in slowly varying environments and approaches its minimum value of one future change in high dimensions. A comprehensive Monte Carlo study validates the theoretical predictions, examines sensitivity to modeling assumptions and parameter uncertainty, and illustrates how the bounds can support deployment decisions after optimization. The resulting framework provides an analytical characterization of deployment lifetime and identifies when a required deployment horizon can be guaranteed, ruled out, or remains analytically unresolved.
Read the full abstract ▾
Machine Learning (Statistics) · Cross-listed from cs.LG
Rethinking EEG-Based Disease Diagnosis: Decoupling Instance Representation Learning from Subject-Level Supervision
Zhiyuan Ma, Zeyuan Li, Zhiyi Lu et al. (+7 more)
EEG-based disease diagnosis requires one prediction per subject, yet common pipelines segment recordings into short instances, inherit the subject label for every instance, and train instance-level classifiers. This assumes that all instances provide equally reliable diagnostic evidence. Multiple instance learning (MIL) avoids inherited labels by treating each subject as a bag. However,
EEG datasets contain far fewer subjects than instances, which can limit the quality of the representations learned by end-to-end MIL. We propose BridgeMIL, a two-stage framework that decouples instance representation learning from subject-level supervision. Stage 1 pretrains the encoder without inherited instance labels by aligning temporally nearby windows and independently sampled within-subject sub-bags. Variance and covariance regularization prevent collapse and reduce redundancy without negative pairs. Stage 2 transfers the encoder to an
attention-based MIL aggregator, applies supervision only to subject predictions, and limits representation drift through feature retention. Across three
EEG disease
datasets and five representative backbones, BridgeMIL attains the highest mean accuracy in 14 of 15
dataset-backbone settings and an overall mean accuracy of 76.57%, 4.28 percentage points higher than the strongest baseline. Further analyses reveal substantial variation in inherited-label reliability across instances, greater performance sensitivity to subject scarcity than to instance scarcity, and a more structured representation space with distinct subject-wise clusters and improved separation between diagnostic classes. Together, these findings underscore the importance of aligning supervision with the subject-level prediction objective while learning from abundant
EEG instances without assigning disease labels to individual instances.
Read the full abstract ▾
All authors Zhiyuan Ma, Zeyuan Li, Zhiyi Lu, Jiacheng Hao, Youlang Du, Zhen Jiang, Xinche Zhang, Yuhao Sun, Xinke Shen, Sen Song
Statistical Methodology · Cross-listed from cs.LG
DoTime: A Synthetic Benchmark Generator for Interventional and Counterfactual Time Series
Dennis Thumm, Billy Tim Anthony and Ying Chen
Most
benchmarks for causal inference over time series are observational, small, or domain-specific, leaving interventional and counterfactual estimation under-served exactly where it matters most, such as in healthcare, policy evaluation, and
climate science. We introduce DoTime, an open, scalable, and theoretically grounded generator of multivariate temporal structural causal models (TSCMs) with interventions, released as the \code{dotime} PyPI package together with four frozen evaluation suites. Beyond existing work, it adds capabilities absent from prior generators: continuous-time intervention windows, counterfactual sampling modes with a positivity guard, regime-switching SCMs as a strict generalization of interrupted time series, non-stationary dynamics by construction with switching SCM parameters, and deterministic ramp and sinusoidal intervention profiles that place trends and structural breaks inside the evaluation window. Moreover, it demonstrates the suitability of the generator as a prior for a causal foundation model reference implementation. The released suites span a training-scale snapshot of $100{,}000$ trajectories and eight named identification structures, each with exact ground truth: paired interventional trajectories from the same SCM throughout, and shared-noise counterfactuals in the continuous-time suite. We ship reference baseline implementations with an evaluation harness, and pose a falsifiable claim: interventional training buys a measurable direction-accuracy advantage over an observational model of identical capacity. It is tested across three training seeds per arm. Under structure-matched evaluation on held-out episodes, the interventional prior-fitted network's (PFN) gap is positive in every structure, trajectory length, and seed tested.
Read the full abstract ▾
Other Statistics
The Fidelity and Feedback Traps: The Case for Health Digital Twins as Modular Evolving Causal Systems
Nikki L. B. Freeman, Yating Zou, Kyungbok Lee et al. (+3 more)
Digital twins for health may be used to compare treatments, project patient trajectories, and support clinical decisions. While related to mechanical digital twins, those initially developed for engineering applications, replicating the mechanical digital twin architecture and goals may fail in health for two reasons. The fidelity trap is the belief that an accurate model can answer what-if questions by virtue of its accuracy. Prediction and counterfactual
reasoning are different tasks, and a twin that can fit past trajectories well may miss the mark when ranking treatments. The feedback trap arises when the twin updates on data its own recommendations helped generate. Refitting in this way can recover a biased relationship and grow more confident even as data grows thinner. We contend that health digital twins should be conceived as causally valid, modular, and evolving systems. Modularity isolates the data and models needed for interventional recommendations, causal validity supports such claims, and governed
evolution updates the twin while accounting for how its recommendations reshape the data. We conclude that the standard for a health twin should be how well it supports decisions in the world it helps create, not how faithfully it reproduces the world it observes.
Read the full abstract ▾
All authors Nikki L. B. Freeman, Yating Zou, Kyungbok Lee, Chenyao Yu, Didong Li, Michael R. Kosorok
Statistical Methodology
An Interpretable Low-Rank State-Space Model for Multi-Horizon Simulation of Large-Scale Regional Temperature Fields
Varun Kotharkar and Michael L. Stein
We propose an interpretable low-rank state-space model for conditional simulation of daily regional temperature fields. The central statistical question is whether empirical orthogonal functions (EOFs) can be treated as stable large-scale features of the field rather than only as sample-dependent basis vectors for dimension reduction. The framework represents the dominant temperature field through a small number of retained EOF coefficients, models their seasonal mean and variance structure, propagates the resulting low-dimensional state with stable multivariate dynamics, and uses structured innovations to represent the remaining uncertainty. The resulting reduced-rank model is interpretable, computationally efficient, and suitable for iterative ensemble generation. It is designed to support both inference on the structure of the retained temperature state and prediction through multi-horizon probabilistic field simulation.
Read the full abstract ▾
Statistics Applications
Rainfall is rough
Thomas Deschatre, Marc Hoffmann and Mathieu Rosenbaum
We propose a new approach to model rainfall by combining heterogeneous data sources at different time scales. Continuous arrivals of rain
cells are incorporated into a Hawkes process formalism that encompasses the classical Bartlett-Lewis and Neyman-Scott models, thereby providing a more flexible representation of clustering. Analysis of high frequency rainfall data (at the minute scale over several years) indicates that critical Hawkes processes with heavy-tailed power-law kernels yield a superior fit relative to classical models and alternative kernel specifications. Scaling arguments inspired by Jaisson and Rosenbaum (2016) imply that aggregated rainfall at coarse time scales converges to a rough fractional process with Hurst exponent close to zero. This prediction is supported by empirical evidence from low-frequency data (annual observations spanning centuries to millennia), where the Hurst exponent is estimated to lie between 0.01 and 0.1 based on either direct observations from weather stations or proxy reconstructions such as tree-ring records. These results establish a connection between rainfall dynamics and models developed in quantitative finance for
market microstructure and
volatility. They also provide a new perspective on classical scaling phenomena originally studied by Hurst and Mandelbrot.
Read the full abstract ▾
Statistical Methodology · Cross-listed from cs.DS
Linear time approximation of the TV distance between product distributions
Konrad Anand, Alistair Benford and Heng Guo
We present a linear time approximation
algorithm of the total variation distance between two product distributions. The main
algorithm was found using ChatGPT 5.6 Sol Ultra.
Statistics Theory
The Kaplan-Meier estimator as a limit function of Efron's self-consistency iterations
Miroslav Bacak
In 1967 Efron showed that the Kaplan-Meier
estimator can be defined as a fixed point of a certain mapping, calling this property “self-consistency”. He also proposed an iterative
algorithm for approximating this fixed point and suggested its convergence. The purpose of the present note is to prove this fact.
Read the full abstract ▾
Machine Learning (Statistics)
PIKS: Universal Physics-Informed Kernel Methods
Joachim Bona-Pellissier, Giacomo Meanti, Matteo Santacesaria et al. (+1 more)
Physics-informed machine learning incorporates physical principles –often expressed via differential operators– into data-driven models. While physics-informed neural networks (PINNs) dominate empirical applications, the complexity of neural network architectures and optimization landscapes hinders the development of a corresponding learning theory. In turn, kernel methods offer an appealing alternative with closed-form solutions and analytical tractability, yet existing guarantees primarily cover the well-specified setting where the target belongs to the native Reproducing Kernel
Hilbert Space (RKHS). This imposes unrealistic regularity assumptions that physical targets often fail to satisfy. In this paper, we introduce and analyze Physics-Informed Kernel methodS (PIKS). We establish the universal consistency of PIKS for linear differential constraints, proving that for universal kernels (such as Gaussian or Matérn), the
estimator asymptotically learns the target while satisfying physical constraints. We further derive finite-sample bounds under suitable source conditions. Our analysis is based on extending classical operator-theoretic analysis of kernel methods to physics-informed machine learning. Numerical experiments demonstrate that PIKS can be competitive with PINNs and traditional finite element methods.
Read the full abstract ▾
All authors Joachim Bona-Pellissier, Giacomo Meanti, Matteo Santacesaria, Lorenzo Rosasco
Statistics Theory · Cross-listed from math.PR
Second-Order Multi-Set Allocation Occupancy (MAO) Distributions under Pairwise-Intersection Constraints: Exact Laws, MAO Norms, Inequalities, and Limit Theory
Xing-gang Mao
Our previous work established the multi-set allocation occupancy (MAO) distribution theory, including the norms, inequalities, and limit theory, under constraints on set sizes alone. By further conditioning on all pairwise intersections while leaving triple and higher-order membership patterns random, we develop the second-order extension. This extension naturally identifies the earlier marginal-size-only framework as the first-order MAO theory. Let $N$ be the population size, $T$ the number of labelled sets, and $M$ a feasible symmetric
matrix whose diagonal and off-diagonal entries specify marginal sizes and pairwise intersections. Write $a=(a_B)_{B\subseteq[T]}$ for the atomic membership counts, where $a_B$ is the number of elements belonging to exactly the sets indexed by $B$, and let $A(N,M)$ be the resulting feasible atomic region. With labelled multiplicity $w(a)=N!/\left(\prod_{B\subseteq[T]}a_B!\right)$, $Z_{N,M}=\sum_{a\in A(N,M)}w(a)$, we define the second-order exact-$t$ and at-least-$t$ MAO norms by the direct atom formulas $\lVert t^r\rVert_T=\left(\sum_{a\in A(N,M)}\left(\sum_{|B|=t}a_B\right)_r w(a)\right)/\left((N)_r Z_{N,M}\right)$, $\lVert [t,T]^r\rVert_T=\left(\sum_{a\in A(N,M)}\left(\sum_{|B|\geq t}a_B\right)_r w(a)\right)/\left((N)_r Z_{N,M}\right)$. The moments can be calculated exactly based on the norms: If $X_{=t}$ and $X_{\geq t}$ denote the numbers of elements with membership degree exactly $t$ and at least $t$, respectively, then for every $\nu\geq1$, $\mathbb{E}_{N,M}[X_{=t}^{\nu}]=\sum_{i=1}^{\nu}S(\nu,i)\lVert t^i\rVert_T$, $\mathbb{E}_{N,M}[X_{\geq t}^{\nu}]=\sum_{i=1}^{\nu}S(\nu,i)\lVert [t,T]^i\rVert_T$. We further developed Poisson and normal limiting theory, verified by numerical approximation. The model provides a systematic route to higher-order MAO theories by prescribing intersections up to any chosen order.
Read the full abstract ▾
Statistical Methodology
Recovering the Target Hazard Ratio Under Nonproportional Hazards Induced by an Omitted Covariate: Simulation-based Approach
Jong-Hyeon Jeong
When an omitted
covariate whose inclusion would balance proportional hazards is excluded from a proportional hazards model, bias in the estimated treatment effect may arise. The omitted
covariate may represent an unobservable biomarker status, an overlooked stratification factor, or a strong continuous prognostic factor. In this paper, we propose a simple simulation-based approach for recovering the target hazard ratio for treatment effect, defined as the hazard ratio from the correctly specified proportional hazards model that includes the omitted
covariate. Our approach identifies the target hazard ratio value that generates a band of survival curves enclosing the observed survival curve estimates most, under the minimal assumptions of a Weibull baseline event-time distribution, (a mixture of) uniform censoring, and unit variance of the omitted
covariate. Simulation studies indicate that the proposed method recovers the target hazard ratio reasonably well under practical scenarios involving a broad range of true hazard ratios, regardless of the true distribution of the omitted
covariate. Consistency of the empirical estimates from the proposed procedure to the true values is proved. We illustrate the proposed method using data from a phase III breast cancer clinical trial.
Read the full abstract ▾
Machine Learning (Statistics) · Cross-listed from cs.LG
BayesAME: Bayesian Active Model Evaluation
Paula Cordero Encinar, Taylan Cemgil, Arnaud Doucet et al. (+2 more)
Evaluating large generative models across
benchmarks is time-consuming and computationally expensive. This drives the need for methods that can estimate full
benchmark performance by evaluating models on only a subset of items, known as a coreset. Current literature mostly requires the practitioner to input a coreset size. However, when reliable performance estimation takes priority over efficiency, an evaluation method should also be capable of automatically determining a coreset size that reflects this priority. We introduce BayesAME, a sequential
Bayesian framework specifically targeting automatic determination of the coreset size. BayesAME models performance as a random variable by defining a latent ability for each group of items sharing the same historical model performances, with a joint prior distribution encoding the belief that the target model behaves similarly to these historical models. The posterior distribution over these abilities is used to derive performance
estimators, quantify performance uncertainty, and select items to add to the coreset via an information-gain criterion. The coreset is iteratively augmented until the performance estimate fluctuation and the performance uncertainty fall below their respective user-defined thresholds. We propose a multi-target extension that captures performance correlations across multiple target models to further reduce the coreset size. Through extensive experiments across diverse
benchmarks, we demonstrate that BayesAME consistently outperforms sequential adaptations of existing methods. Crucially, our comprehensive analysis addresses recent skepticism in the literature, establishing that non-random coreset selection is advantageous over random selection. Finally, we highlight that leveraging continuous response log-likelihoods over traditional binary scores significantly enhances estimation accuracy.
Read the full abstract ▾
All authors Paula Cordero Encinar, Taylan Cemgil, Arnaud Doucet, Virginia Aglietti, Silvia Chiappa
Statistical Methodology
PRESCCO: Efficient Prediction Intervals under a Right-Censored Covariate
Kihyun Han, Yanyuan Ma, Karen Marder et al. (+1 more)
In clinical studies, a patient's outcome, e.g., a cognitive test score, is typical or atypical depending on how it compares with the outcomes of patients at a similar point in a neurodegenerative disease, measured by how far they are from a common disease event. A prediction interval based on the time to that event provides that comparison, but that time is right-censored for most patients. Yet no method had computed such a prediction interval in this right-censored
covariate setting. We first adapt three conformal prediction methods to this setting, and show that the estimated half-length, the distance the interval runs either side of its center, varies from one study to the next, so the same outcome can be judged typical in one study and atypical in another. We then develop the PRESCCO method, whose
estimator of the half-length is semiparametrically efficient and doubly robust, staying consistent when one of its two models is misspecified, while the method loses no coverage. In simulations its standard deviation is four to thirty times smaller than under any conformal prediction method, and in a Huntington disease study with 77.2% right-censoring, an outcome typical in one study is no longer atypical in another.
Read the full abstract ▾
All authors Kihyun Han, Yanyuan Ma, Karen Marder, Tanya P. Garcia
Machine Learning (Statistics)
Feature Bagging Provides Stability
Yuheng Ma and Qiang Sun
We study feature bagging through the lens of algorithmic stability. Feature bagging is an ensemble strategy that aggregates base learners trained on randomly subsampled feature subsets, possibly in a data-dependent manner. We introduce feature instability (FI), the feature-axis analogue of instance instability (II), which measures sensitivity to removing a single feature. Smaller values of II or FI correspond to stronger stability, and our experiments show that FI captures generalization-relevant information complementary to II. Within this framework, we analyze feature bagging in both a parametric linear model and a model-free setting inspired by recursive feature subsampling in random forests. In both settings, we establish formal guarantees showing that feature bagging improves the relevant stability relative to its non-bagged counterpart, with larger improvements under more aggressive subsampling. We further show that a modest number of bagging rounds is sufficient to approach the infinite-bagging stability level.
Read the full abstract ▾
Machine Learning (Statistics)
Breaking the Curse with BAND: Nonparametric Distribution Estimation in High Dimensions
Shuo-Chieh Huang, Chien-Ming Chi and Jau-er Chen
Minimax-optimal rates for multivariate distribution estimation are known to suffer from the curse of dimensionality. We propose a sparse
Bayesian network approach in which each conditional probability is estimated using sparsity-aware conditional mean methods. The resulting
estimator,
BAyesian Network Distribution regression (BAND), handles mixed data types in high-dimensional time series and achieves
polynomial total variation convergence rates while allowing the feature dimension to grow polynomially with the sample size. These rates are substantially faster than the classical optimal rates for multivariate histogram density
estimators that lack sparsity. Empirical evaluations show that BAND performs competitively for data sampling and confidence region
forecasting against a range of state-of-the-art
benchmarks.
Read the full abstract ▾
Statistical Methodology
Bayesian Plackett–Luce latent block models for ranked data
Lapo Santi, Nial Friel and Valeria Vitelli
We introduce a
Bayesian latent block model that jointly partitions assessors and items under a Plackett–Luce observation model. Assessors are assigned to $C$ clusters and items to $K$ blocks; items in a block share a common strength parameter within each assessor cluster, yielding a parsimonious $C\times K$ co-clustering representation. Independent Gnedin priors infer $C$ and $K$. Data augmentation gives conjugate Gibbs updates and a tractable MCMC sampler with split-merge moves. Simulations characterize recovery and posterior uncertainty as signal, ranking depth, and group balance vary. Applied to the cancer gene atlas (TCGA) pan-cancer top-500 gene-expression rankings, the model reveals tissue-driven sample structure while compressing gene-level heterogeneity into interpretable blocks. Rank-based GSEA of posterior gene scores supports biological interpretation.
Read the full abstract ▾
Machine Learning (Statistics)
Conformalized Rate-Adaptive Sensing
Jiawei Yang and Yao Zhang
Many high-resolution imaging systems face the same fundamental question: when have enough measurements been collected to reconstruct an image accurately? We develop Conformalized Rate-Adaptive Sensing (CoRAS), a method that adaptively chooses an acquisition or compression rate for each image while keeping the reconstruction error below a target level with high probability. As measurements are collected, an image reconstruction model gradually recovers the true image, producing a reconstruction path over acquisition rates. CoRAS uses this path up to an early decision time to estimate the target stopping time, defined as the first time at which the reconstruction error falls below the target level. It then calibrates this estimate using images with similar early reconstruction behavior, producing an upper bound on the stopping time with marginal and approximate conditional coverage guarantees. Experiments on image
datasets show that CoRAS attains the target stopping-time coverage, uses fewer measurements on average than fixed-rate stopping rules, and assigns more measurements to images that are harder to reconstruct.
Read the full abstract ▾
Machine Learning (Statistics)
Think Short, Defer Smart, Act, and Repeat: Calibrated Reasoning and Uncertainty-Aware Deferral for Edge LLM Agents
Amirmohammad Farzaneh and Osvaldo Simeone
LLM
agents following the ReAct paradigm are promising enablers of complex multi-step tasks, including multi-hop question answering, code generation, and control of physical AI systems. Yet, when deployed at the edge, they must tightly manage their
reasoning budget while remaining reliable and deferring to a cloud-side model only when local uncertainty is too high to act safely. We propose Think Short, Defer Smart (TSDS), a framework that synergistically integrates a lightweight convergence probe, which halts on-device
reasoning once the intended action has stabilized, with a perplexity-based deferral rule that escalates uncertain actions to a cloud-side model. Both mechanisms are jointly calibrated on end-to-end episode trajectories via a multi-objective Learn-Then-Test (LTT) procedure, providing simultaneous finite-sample guarantees on expected episode reward and cloud-call rate. We evaluate TSDS on four ReAct
benchmarks spanning arithmetic
reasoning (GSM8K), multi-hop question answering (HotpotQA), code generation (MBPP), and multi-step
embodied planning (household
robot), and compare against thought-calibration-only and calibrated-deferral-only standalone baselines. TSDS reduces per-episode thinking compute by 43%-65% over deferral-only baselines across HotpotQA, MBPP, and the household
robot task, while maintaining certified reward and cloud-call rate guarantees.
Read the full abstract ▾
Statistical Methodology
Uniform Convergence of Generalized Conditional Fréchet Means with Applications to Weighted Fréchet Aggregation and Exceedance Set Estimation
Houren Hong, Jiazhen Xu and Andrew T.A. Wood
The statistical analysis of object oriented data in non-Euclidean spaces heavily relies on generalized conditional Fréchet means, notably in the context of Fréchet regression. However, establishing the uniform convergence of these
estimators presents several theoretical challenges. The difficulties are caused primarily by the absence of linear structures in general metric spaces, rendering standard techniques for verifying the asymptotic uniform equicontinuity of the
estimator largely intractable. To overcome this limitation, this paper introduces an alternative theoretical framework for establishing uniform convergence that bypasses the need to verify uniform equicontinuity, under a novel structural condition on the empirical cost function of the generalized conditional Fréchet means. We demonstrate that this analytical condition is satisfied by various prominent Fréchet regression models across broad classes of metric spaces. Leveraging these foundational uniform convergence guarantees, we subsequently extend two widely used frameworks from Euclidean to non-Euclidean spaces: (i) a weighted Fréchet aggregation framework that facilitates both distributed regression and robust median-of-means regression; and (ii) an exceedance set estimation framework to identify critical
covariate regions where the conditional generalized Fréchet mean surpasses a prescribed threshold, alongside a metric to quantify the aggregate magnitude of the exceedance. The theoretical properties of these proposed methods are empirically validated through Monte Carlo simulations and an application to dynamic transportation networks in New York City.
Read the full abstract ▾
Machine Learning (Statistics)
Crossing-Free Probabilistic K-Line Forecasts Without Retraining
Runyao Yu, Yuchen Tao, Yujie Chen et al. (+2 more)
Probabilistic K-line
forecasting describes uncertainty in four complementary prices, namely open–high–low–close (OHLC). However, it introduces two consistency problems:
quantile crossing and K-line crossing.
Quantile crossing occurs when a higher-
quantile forecast falls below a lower-
quantile forecast, while K-line crossing occurs when the forecast low exceeds the open or close, or the forecast high falls below the open or close. Existing solutions generally address only one problem through output reordering, specialized architectures, or penalized training objectives. We propose K-line–
Quantile Sequential Projection (KQSP), a parameter-free and training-free reconciliation method applicable to forecasts produced by any model. Compared with other crossing solutions, KQSP preserves predictive accuracy while producing substantially smaller corrections to the original forecasts. To mitigate model bias, we evaluate KQSP using various models, including pretrained foundation models. KQSP reduces both
quantile and K-line crossing rates to zero for all test data undertaken. These results show that probabilistic K-line consistency can be enforced independently of forecast generation and without retraining.
Read the full abstract ▾
All authors Runyao Yu, Yuchen Tao, Yujie Chen, Wentao Wang, Derek W. Bunn
Statistics Theory
Compactly supported radial basis functions as probability density functions
Sergio Díaz-Elbal, Andrei Martínez-Finkelshtein and Darío Ramos-López
Compactly Supported Radial Basis Functions (CS-RBFs) are a fundamental tool in multivariate approximation theory. However, their use in statistics and probability modeling remains underexplored, having been used mainly to express covariance functions in Gaussian processes or as kernel functions. This work explores CS-RBFs as a novel parametric family of probability density functions, focusing in particular on Wendland $\mathscr{C}^2$ kernels. The primary contribution of this work is the derivation of analytical expressions for various statistical properties, such as moments and the cumulative distribution function, of CS-RBFs as univariate and conditional densities. The approach comprises two alternative scenarios: when the CS-RBF support lies entirely within the variable's domain (untruncated support) and when part of it is outside (truncated support). Mixture models employing CS-RBFs are also analyzed, and their main properties are detailed. Furthermore, we introduce an incremental learning
algorithm for density estimation with CS-RBF mixture models, in which centers are determined using k-means and weights and shape parameters are optimized by
stochastic gradient descent. Experiments on synthetic and real-world
datasets show that CS-RBF densities provide competitive results in terms of likelihood and model complexity in comparison with Gaussian mixture models. In addition, these CS-RBF densities allow the exact computation of key distributional properties in univariate and conditional settings.
Read the full abstract ▾
Statistical Methodology
Robust Interpolated Quantile Estimators: Asymptotic Theory and Efficiency
Saïd Maanan, Azzouz Dermoune, Ahmed El Ghini et al. (+1 more)
This paper introduces a unified family of interpolated
quantile estimators obtained by augmenting the check loss with quadratic, Huber, or Tukey's bisquare regularization. The
estimators are indexed by the
quantile level $\tau$ and an interpolation parameter $h$. They reduce to the classical empirical
quantile when $h=0$, while increasing $h$ continuously shifts the effective probability level toward the center of the distribution. A complete asymptotic theory is developed. For the quadratic interpolation, the effective
quantile level is characterized by an interpolation equation yielding a closed-form parametrization of neighboring
quantiles. Asymptotic normality is established for all three interpolated
estimators via M-estimation, and a decomposition of the asymptotic variance explains how efficiency depends on the underlying distribution. Numerical experiments show that the quadratic interpolated
estimator can reduce asymptotic variance by up to 36% for light-tailed distributions and up to 57% for heavy-tailed or asymmetric distributions for suitable interpolation strength. The framework is extended to linear
quantile regression, where Monte Carlo experiments show that Huber interpolation is beneficial only in a narrow neighborhood of the median, while ordinary
quantile regression remains preferable elsewhere. An application to daily log-returns illustrates the practical relevance of the proposed methodology for tail estimation under heavy tails and asymmetry.
Read the full abstract ▾
All authors Saïd Maanan, Azzouz Dermoune, Ahmed El Ghini, Daoud Ounaissi
Machine Learning (Statistics)
Early Failure Prediction from Near-Anomaly Detection: A Proactive Approach
Léa Billet, Louise Travé-Massuyès, Elodie Chanthery et al. (+1 more)
Anomaly detection methods often have uncertain behavior with respect to samples near the distribution boundary, limiting their ability to anticipate future anomalies. This work introduces the concept of near-anomalies that, while not yet anomalous, lie close to the boundary and are likely to transition into anomalies in the near future. To address this, we propose an unsupervised method, named Christoffel-based ANomaly Anticipation for eaRly dIscovery (CANARI), which leverages the strong theoretical foundations of the Christoffel function to detect near-anomalies. The method is validated on industrial in-
circuit testing data from printed
circuit boards, with synthetically generated near-anomaly samples due to the lack of real-world data labeling. Experimental results show that CANARI outperforms the compared baselines that generally use a dual-threshold mechanism (one for anomalies and one for near-anomalies). It therefore provides a proactive solution for anticipating anomalies before they occur, offering a promising approach for resilience, predictive maintenance, and quality control.
Read the full abstract ▾
All authors Léa Billet, Louise Travé-Massuyès, Elodie Chanthery, Alexandre Gaffet
Machine Learning (Statistics) · Cross-listed from cs.LG
Universality and Approximation Rates of Graph Neural Networks with Random Features
Lukas Gonon, Thilo Meyer-Brandis and Niklas Weber
We investigate message-passing graph neural networks with random node features. Random node features are known to enhance the expressiveness of graph neural networks (GNNs) both theoretically and empirically. Here, we establish a novel universality result focusing on permutation-equivariant neural networks (PENNs), a class of GNNs built from feedforward neural network components that subsumes many prominent GNN architectures. We show that PENNs, combined with partially random node features, can approximate arbitrarily well in probability any measurable permutation-invariant or permutation-equivariant function on directed graphs of fixed size with multidimensional node and edge features. For $k$-times continuously differentiable functions, $k\geq 2$, we also derive upper bounds on the approximation rates, relating the complexity of the feedforward components of a PENN in terms of layer depth and number of nonzero weights to the desired approximation accuracy.
Read the full abstract ▾
Statistics Applications · Cross-listed from physics.soc-ph
Structure of System-Specific Hazard Modeling for Physical Infrastructures in a Climate Change Context
Matthieu Dutel
This paper addresses the definition and modeling of hazards in the context of physical systems, particularly infrastructures, that are affected by
climate change. The paper highlights that hazards are system-dependent, meaning what constitutes a hazard for one system (e.g., humans) may not be the same for another (e.g., infrastructures). The paper also highlights that extreme intensity distribution may evolve in a region without necessarily constituting a hazard for a specific system. These distinctions are crucial for risk assessment and adaptation strategies in a changing
climate. The paper implements a simple threshold-based hazard model -Boolean Hazard Model with Probability -to focus exclusively on system-specific hazard definition in climatechange context. Use cases illustrate how this approach adapts to different systems and hazard types. The model produces time-evolving hazard maps, delivering hazard data tailored to both hazard type and infrastructure characteristics. The model provides hazard data tailored to specific hazard types and physical systems, with a focus on infrastructure. The use cases demonstrate their practical value and potential for broader application in multi-infrastructure and multi-hazard exposure modeling.
Read the full abstract ▾
Statistics Theory
Hub Neighbor-Degree Diagnostics for Sparse Random Graphs
Qian Hui and Tiandong Wang
Networks with nearly identical degree distributions can place their hubs in sharply different neighborhoods. We develop a model diagnostic based on the mean degree of the neighbors of a degree-$k$ vertex. Under rank-one inhomogeneous random graphs, this statistic has degree-invariant centering and $k^{-1/2}$ fluctuations. Under non-rank-one kernels, posterior uncertainty about the root type can instead determine both centering and scale. Under linear preferential attachment, the statistic grows as $(m+\delta)\log k$. We turn these model-specific limits into goodness-of-fit tests for specified sparse-graph nulls and a weighted log-degree slope test for residual hub-neighborhood trends. Simulations evaluate null calibration, degree-distribution misspecification, and power against degree-matched preferential-attachment alternatives. Applications to high-school contact and arXiv coauthorship networks show that the method separates level misspecification from disassortative and positive residual trends. Reddit interaction networks provide a further appendix example.
Read the full abstract ▾
Statistics Applications · Cross-listed from gr-qc
Bayesian nonparametric estimation of correlated gravitational wave detector network noise using matrix-gamma process priors
Yixuan Liu, Renate Meyer, Nelson Christensen et al. (+4 more)
This paper addresses the important problem of estimating the noise spectral density of next-generation gravitational-wave detectors, such as LISA and the Einstein
Telescope (ET), where cross-channel correlations must be accounted for to avoid biased parameter estimation of gravitational-wave signals. Unlike approaches that estimate test-mass and optical-metrology-system noise separately at the single-link level and then map them to the Time-Delay Interferometry (TDI) channels through known transfer functions, we develop a
Bayesian nonparametric method that directly estimates the spectral density
matrix of the XYZ channels, thereby accommodating additional sources of uncertainty. Our approach combines a flexible
matrix-gamma process prior on the
matrix-valued coefficients of a Bernstein
polynomial basis expansion with a blocked multivariate Whittle likelihood. The prior guarantees Hermitian positive definiteness of the spectral estimate at every frequency. To avoid reversible-jump methods, we use an adaptive Markov chain Monte Carlo (MCMC)
algorithm for posterior sampling. The proposed framework can also be used to correct misspecified parametric noise models. Results from a simulation study and simulated correlated-noise data for both LISA and ET demonstrate the effectiveness of the proposed method.
Read the full abstract ▾
All authors Yixuan Liu, Renate Meyer, Nelson Christensen, Jeung Eun Lee, Jianan Liu, Patricio Maturana-Russel, Avi Vajpeyi
Statistical Methodology · Cross-listed from math.NA
Bayesian Inference of Discretization Error Means in ODEs via Ensemble Kalman Filtering
Shoji Toyota and Yuto Miyatake
We propose a
Bayesian framework to quantify discretization errors in numerical solutions of ODE models based on observational data. The discretization error is modeled as a random variable, and its mean-referred to as the discretization error mean-is inferred from the observations. By introducing a Markov prior on the temporal
evolution of the discretization error mean, we formulate the problem as a state-space model with a linear Gaussian observation process, which enables efficient inference via the Ensemble Kalman Filter. We also propose a specific form of a Markov prior motivated by classical discretization error analysis, in which global errors accumulate from local errors. The proposed prior depends on the step size of a numerical solver, and we establish its convergence rate in probability as the step size tends to zero. Numerical experiments on the pendulum system and the FitzHugh-Nagumo model demonstrate the effectiveness of the proposed approach.
Read the full abstract ▾
Statistics Theory · Cross-listed from math.PR
An RDT based confirmation of Lehner's formula for Kronecker-Gaussian matrices
Mihailo Stojnic
Remarkable breakthroughs [25,43] established the so-called strong asymptotic freeness between classical Gaussian random ensembles and their semicircular free counterparts. Along the same lines, the Lehner formula [31], associated with the free counterpart, precisely determines the spectral edges of Kronecker-Gaussian
matrices. We here revisit and study this formula without the utilization of random
matrix theory and spectral methods. In particular, relying on concepts utilized within Random Duality Theory (RDT) [45,46,51], we reconfirm Lehner's formula and effectively reprove the key asymptotic freeness results obtained via spectral methods in [25,43].
Read the full abstract ▾